2018-11-25 13:25:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:25:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 13:25:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 13:25:48 [DEBUG   ] Got command RPT from MCS: ref #622979
2018-11-25 13:25:48 [DEBUG   ] summary = ERROR
2018-11-25 13:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   622979  13 58447 48348393 A  ERRORERROR'
2018-11-25 13:25:48 [DEBUG   ] Got command RPT from MCS: ref #622980
2018-11-25 13:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   622980  77 58447 48348394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:25:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:25:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:25:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:25:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:25:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:25:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:25:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:25:55 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-11-25 13:26:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 13:26:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 13:26:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:26:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 13:26:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:26:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:26:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:26:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:26:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:26:55 [DEBUG   ] Finished updating board flags in 1.757 seconds
2018-11-25 13:27:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:27:17 [DEBUG   ] Got command RPT from MCS: ref #622996
2018-11-25 13:27:17 [DEBUG   ] summary = ERROR
2018-11-25 13:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   622996  13 58447 48437857 A  ERRORERROR'
2018-11-25 13:27:18 [DEBUG   ] Got command RPT from MCS: ref #622997
2018-11-25 13:27:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   622997  77 58447 48438061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:27:18 [DEBUG   ] Got command RPT from MCS: ref #622998
2018-11-25 13:27:18 [DEBUG   ] summary = ERROR
2018-11-25 13:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   622998  13 58447 48438265 A  ERRORERROR'
2018-11-25 13:27:18 [DEBUG   ] Got command RPT from MCS: ref #622999
2018-11-25 13:27:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   622999  77 58447 48438469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:27:18 [DEBUG   ] Got command RPT from MCS: ref #623000
2018-11-25 13:27:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 13:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623000  12 58447 48438661 A  ERRORB˜™š'
2018-11-25 13:27:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:27:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 13:27:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 13:27:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:27:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:27:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:27:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:27:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:27:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:27:55 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-25 13:28:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 13:28:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:28:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:28:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:28:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 13:28:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:28:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:28:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:28:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:28:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:28:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:28:55 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-25 13:29:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 13:29:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:29:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:29:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:29:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:29:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:29:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:29:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:29:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:29:55 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-25 13:30:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 13:30:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 13:30:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 13:30:48 [DEBUG   ] Got command RPT from MCS: ref #623009
2018-11-25 13:30:48 [DEBUG   ] summary = ERROR
2018-11-25 13:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623009  13 58447 48648397 A  ERRORERROR'
2018-11-25 13:30:48 [DEBUG   ] Got command RPT from MCS: ref #623010
2018-11-25 13:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623010  77 58447 48648398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:30:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:30:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:30:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:30:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:30:55 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-11-25 13:31:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 13:31:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 13:31:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 13:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:31:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 13:31:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:31:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:31:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:31:55 [WARNING ] (13, 1, 'bot')
2018-11-25 13:31:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:31:55 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-25 13:32:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 13:32:17 [DEBUG   ] Got command RPT from MCS: ref #623028
2018-11-25 13:32:17 [DEBUG   ] summary = ERROR
2018-11-25 13:32:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623028  13 58447 48737951 A  ERRORERROR'
2018-11-25 13:32:18 [DEBUG   ] Got command RPT from MCS: ref #623029
2018-11-25 13:32:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623029  77 58447 48738142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:32:18 [DEBUG   ] Got command RPT from MCS: ref #623030
2018-11-25 13:32:18 [DEBUG   ] summary = ERROR
2018-11-25 13:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623030  13 58447 48738345 A  ERRORERROR'
2018-11-25 13:32:18 [DEBUG   ] Got command RPT from MCS: ref #623032
2018-11-25 13:32:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623032  77 58447 48738549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:32:18 [DEBUG   ] Got command RPT from MCS: ref #623033
2018-11-25 13:32:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 13:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623033  12 58447 48738753 A  ERRORB™™š'
2018-11-25 13:32:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:32:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:32:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:32:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:32:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:32:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:32:56 [DEBUG   ] Finished updating board flags in 2.204 seconds
2018-11-25 13:33:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 13:33:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 13:33:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:33:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:33:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:33:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:33:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:33:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:33:56 [DEBUG   ] Finished updating board flags in 2.195 seconds
2018-11-25 13:34:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:34:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 13:34:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 13:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:34:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:34:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:34:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:34:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:34:56 [DEBUG   ] Finished updating board flags in 2.105 seconds
2018-11-25 13:35:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:35:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:35:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 13:35:48 [DEBUG   ] Got command RPT from MCS: ref #623042
2018-11-25 13:35:48 [DEBUG   ] summary = ERROR
2018-11-25 13:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623042  13 58447 48948393 A  ERRORERROR'
2018-11-25 13:35:48 [DEBUG   ] Got command RPT from MCS: ref #623043
2018-11-25 13:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623043  77 58447 48948394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:35:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:35:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:35:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:35:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:35:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:35:56 [DEBUG   ] Finished updating board flags in 1.895 seconds
2018-11-25 13:36:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:36:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:36:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:36:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:36:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:36:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:36:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:36:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:36:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:36:56 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-11-25 13:37:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-25 13:37:18 [DEBUG   ] Got command RPT from MCS: ref #623063
2018-11-25 13:37:18 [DEBUG   ] summary = ERROR
2018-11-25 13:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623063  13 58447 49038029 A  ERRORERROR'
2018-11-25 13:37:18 [DEBUG   ] Got command RPT from MCS: ref #623064
2018-11-25 13:37:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623064  77 58447 49038233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:37:18 [DEBUG   ] Got command RPT from MCS: ref #623065
2018-11-25 13:37:18 [DEBUG   ] summary = ERROR
2018-11-25 13:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623065  13 58447 49038425 A  ERRORERROR'
2018-11-25 13:37:18 [DEBUG   ] Got command RPT from MCS: ref #623066
2018-11-25 13:37:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623066  77 58447 49038629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:37:18 [DEBUG   ] Got command RPT from MCS: ref #623067
2018-11-25 13:37:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 13:37:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623067  12 58447 49038833 A  ERRORB˜™š'
2018-11-25 13:37:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 13:37:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 13:37:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:37:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 13:37:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:37:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:37:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:37:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:37:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:37:56 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-11-25 13:38:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 13:38:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:38:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:38:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:38:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:38:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:38:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:38:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:38:56 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-25 13:39:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:39:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:39:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:39:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:39:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:39:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:39:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:39:56 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-11-25 13:40:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:40:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:40:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:40:48 [DEBUG   ] Got command RPT from MCS: ref #623072
2018-11-25 13:40:48 [DEBUG   ] summary = ERROR
2018-11-25 13:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623072  13 58447 49248401 A  ERRORERROR'
2018-11-25 13:40:48 [DEBUG   ] Got command RPT from MCS: ref #623073
2018-11-25 13:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623073  77 58447 49248402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:40:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:40:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:40:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:40:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:40:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:40:56 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-11-25 13:41:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:41:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:41:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:41:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:41:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:41:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:41:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:41:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:41:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:41:56 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-11-25 13:42:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:42:18 [DEBUG   ] Got command RPT from MCS: ref #623091
2018-11-25 13:42:18 [DEBUG   ] summary = ERROR
2018-11-25 13:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623091  13 58447 49338113 A  ERRORERROR'
2018-11-25 13:42:18 [DEBUG   ] Got command RPT from MCS: ref #623092
2018-11-25 13:42:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623092  77 58447 49338317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:42:18 [DEBUG   ] Got command RPT from MCS: ref #623093
2018-11-25 13:42:18 [DEBUG   ] summary = ERROR
2018-11-25 13:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623093  13 58447 49338521 A  ERRORERROR'
2018-11-25 13:42:18 [DEBUG   ] Got command RPT from MCS: ref #623095
2018-11-25 13:42:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623095  77 58447 49338713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:42:18 [DEBUG   ] Got command RPT from MCS: ref #623096
2018-11-25 13:42:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 13:42:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623096  12 58447 49338918 A  ERRORB™™š'
2018-11-25 13:42:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:42:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:42:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 13:42:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 13:42:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:42:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:42:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:42:56 [WARNING ] (13, 1, 'bot')
2018-11-25 13:42:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:42:56 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-11-25 13:43:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:43:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:43:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:43:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 13:43:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:43:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:43:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:43:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:43:57 [DEBUG   ] Finished updating board flags in 2.285 seconds
2018-11-25 13:44:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:44:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 13:44:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:44:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:44:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:44:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:44:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:44:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:44:57 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-11-25 13:45:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:45:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:45:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:45:48 [DEBUG   ] Got command RPT from MCS: ref #623109
2018-11-25 13:45:48 [DEBUG   ] summary = ERROR
2018-11-25 13:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623109  13 58447 49548393 A  ERRORERROR'
2018-11-25 13:45:48 [DEBUG   ] Got command RPT from MCS: ref #623110
2018-11-25 13:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623110  77 58447 49548394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:45:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:45:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:45:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:45:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:45:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:45:57 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-11-25 13:46:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:46:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:46:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 13:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:46:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:46:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:46:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:46:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:46:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:46:57 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-11-25 13:47:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 13:47:18 [DEBUG   ] Got command RPT from MCS: ref #623126
2018-11-25 13:47:18 [DEBUG   ] summary = ERROR
2018-11-25 13:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623126  13 58447 49638198 A  ERRORERROR'
2018-11-25 13:47:18 [DEBUG   ] Got command RPT from MCS: ref #623127
2018-11-25 13:47:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623127  77 58447 49638401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:47:18 [DEBUG   ] Got command RPT from MCS: ref #623128
2018-11-25 13:47:18 [DEBUG   ] summary = ERROR
2018-11-25 13:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623128  13 58447 49638605 A  ERRORERROR'
2018-11-25 13:47:18 [DEBUG   ] Got command RPT from MCS: ref #623129
2018-11-25 13:47:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623129  77 58447 49638809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:47:19 [DEBUG   ] Got command RPT from MCS: ref #623130
2018-11-25 13:47:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 13:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623130  12 58447 49639001 A  ERRORB˜™š'
2018-11-25 13:47:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 13:47:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 13:47:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 13:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:47:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:47:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:47:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:47:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:47:57 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-25 13:48:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:48:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:48:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 13:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:48:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:48:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:48:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:48:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:48:57 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-11-25 13:49:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:49:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:49:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 13:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:49:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 13:49:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:49:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:49:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:49:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:49:57 [DEBUG   ] Finished updating board flags in 1.711 seconds
2018-11-25 13:50:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:50:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:50:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:50:48 [DEBUG   ] Got command RPT from MCS: ref #623135
2018-11-25 13:50:48 [DEBUG   ] summary = ERROR
2018-11-25 13:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623135  13 58447 49848397 A  ERRORERROR'
2018-11-25 13:50:48 [DEBUG   ] Got command RPT from MCS: ref #623136
2018-11-25 13:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623136  77 58447 49848398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:50:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:50:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:50:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:50:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:50:57 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-11-25 13:51:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:51:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 13:51:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:51:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:51:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 13:51:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:51:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:51:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:51:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:51:57 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-11-25 13:52:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:52:18 [DEBUG   ] Got command RPT from MCS: ref #623158
2018-11-25 13:52:18 [DEBUG   ] summary = ERROR
2018-11-25 13:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623158  13 58447 49938289 A  ERRORERROR'
2018-11-25 13:52:18 [DEBUG   ] Got command RPT from MCS: ref #623159
2018-11-25 13:52:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623159  77 58447 49938493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:52:18 [DEBUG   ] Got command RPT from MCS: ref #623160
2018-11-25 13:52:18 [DEBUG   ] summary = ERROR
2018-11-25 13:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623160  13 58447 49938685 A  ERRORERROR'
2018-11-25 13:52:18 [DEBUG   ] Got command RPT from MCS: ref #623162
2018-11-25 13:52:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623162  77 58447 49938890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:52:19 [DEBUG   ] Got command RPT from MCS: ref #623164
2018-11-25 13:52:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 13:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623164  12 58447 49939093 A  ERRORB™™š'
2018-11-25 13:52:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 13:52:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:52:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 13:52:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:52:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:52:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:52:57 [WARNING ] (13, 1, 'bot')
2018-11-25 13:52:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:52:57 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-11-25 13:53:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:53:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:53:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:53:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:53:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:53:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:53:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:53:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:53:58 [DEBUG   ] Finished updating board flags in 2.228 seconds
2018-11-25 13:54:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 13:54:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:54:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:54:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:54:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:54:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:54:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:54:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:54:58 [DEBUG   ] Finished updating board flags in 2.219 seconds
2018-11-25 13:55:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 13:55:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:55:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 13:55:48 [DEBUG   ] Got command RPT from MCS: ref #623172
2018-11-25 13:55:48 [DEBUG   ] summary = ERROR
2018-11-25 13:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623172  13 58447 50148397 A  ERRORERROR'
2018-11-25 13:55:48 [DEBUG   ] Got command RPT from MCS: ref #623173
2018-11-25 13:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623173  77 58447 50148398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:55:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:55:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:55:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:55:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:55:58 [DEBUG   ] Finished updating board flags in 2.239 seconds
2018-11-25 13:56:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:56:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 13:56:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 13:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:56:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:56:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:56:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:56:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:56:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:56:58 [DEBUG   ] Finished updating board flags in 2.224 seconds
2018-11-25 13:57:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 13:57:18 [DEBUG   ] Got command RPT from MCS: ref #623189
2018-11-25 13:57:18 [DEBUG   ] summary = ERROR
2018-11-25 13:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623189  13 58447 50238369 A  ERRORERROR'
2018-11-25 13:57:18 [DEBUG   ] Got command RPT from MCS: ref #623190
2018-11-25 13:57:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623190  77 58447 50238573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:57:18 [DEBUG   ] Got command RPT from MCS: ref #623191
2018-11-25 13:57:18 [DEBUG   ] summary = ERROR
2018-11-25 13:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623191  13 58447 50238777 A  ERRORERROR'
2018-11-25 13:57:18 [DEBUG   ] Got command RPT from MCS: ref #623192
2018-11-25 13:57:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 13:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623192  77 58447 50238981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 13:57:19 [DEBUG   ] Got command RPT from MCS: ref #623193
2018-11-25 13:57:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 13:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623193  12 58447 50239173 A  ERRORB˜™š'
2018-11-25 13:57:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 13:57:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 13:57:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 13:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:57:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:57:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:57:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:57:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:57:58 [DEBUG   ] Finished updating board flags in 2.123 seconds
2018-11-25 13:58:00 [DEBUG   ] Got command TBN from MCS: ref #623198
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-11-25 13:58:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   623198   8 58447 50280377 A  ERROR'
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1543154281']
2018-11-25 13:58:00 [DEBUG   ] spawn_process: at 2018-11-25 13:58:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1543154281']
2018-11-25 13:58:00 [INFO    ] Finished spawning TBN in 0.053 s
2018-11-25 13:58:05 [DEBUG   ] Finished updating ant stats in 0.736 seconds
2018-11-25 13:58:25 [DEBUG   ] Finished updating ant stats in 0.665 seconds
2018-11-25 13:58:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 13:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:58:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:58:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:58:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:58:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:58:58 [DEBUG   ] Finished updating board flags in 1.961 seconds
2018-11-25 13:59:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 13:59:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 13:59:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 13:59:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 13:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 13:59:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:59:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:59:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:59:58 [WARNING ] (13, 1, 'bot')
2018-11-25 13:59:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 13:59:58 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-25 14:00:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 14:00:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 14:00:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 14:00:48 [DEBUG   ] Got command RPT from MCS: ref #623203
2018-11-25 14:00:48 [DEBUG   ] summary = ERROR
2018-11-25 14:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623203  13 58447 50448401 A  ERRORERROR'
2018-11-25 14:00:48 [DEBUG   ] Got command RPT from MCS: ref #623204
2018-11-25 14:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623204  77 58447 50448402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 14:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:00:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:00:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:00:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:00:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:00:58 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-11-25 14:01:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 14:01:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-25 14:01:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 14:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:01:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:01:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:01:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:01:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:01:58 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-11-25 14:02:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:02:11 [DEBUG   ] Got command TBW from MCS: ref #623223
2018-11-25 14:02:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-11-25 14:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   623223   8 58447 50531449 A  ERROR'
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-11-25 14:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-11-25 14:02:14 [DEBUG   ] spawn_process: at 2018-11-25 14:02:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-11-25 14:02:14 [INFO    ] Finished spawning TBW
2018-11-25 14:02:18 [DEBUG   ] Got command RPT from MCS: ref #623225
2018-11-25 14:02:18 [DEBUG   ] summary = ERROR
2018-11-25 14:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623225  13 58447 50538453 A  ERRORERROR'
2018-11-25 14:02:18 [DEBUG   ] Got command RPT from MCS: ref #623226
2018-11-25 14:02:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623226  77 58447 50538657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:02:18 [DEBUG   ] Got command RPT from MCS: ref #623227
2018-11-25 14:02:18 [DEBUG   ] summary = ERROR
2018-11-25 14:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623227  13 58447 50538861 A  ERRORERROR'
2018-11-25 14:02:19 [DEBUG   ] Got command RPT from MCS: ref #623229
2018-11-25 14:02:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623229  77 58447 50539065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:02:19 [DEBUG   ] Got command RPT from MCS: ref #623231
2018-11-25 14:02:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623231  12 58447 50539257 A  ERRORB˜™š'
2018-11-25 14:02:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 14:02:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:02:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:02:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:02:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:02:58 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-11-25 14:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:03:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:03:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:03:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:03:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:03:58 [DEBUG   ] Finished updating board flags in 1.309 seconds
2018-11-25 14:04:03 [INFO    ] __waitForTBW - TBW finished in 108.747 s
2018-11-25 14:04:04 [DEBUG   ] Finished updating ant stats in 0.564 seconds
2018-11-25 14:04:04 [INFO    ] Started antennas statistics background thread
2018-11-25 14:04:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1543154646']
2018-11-25 14:04:04 [DEBUG   ] spawn_process: at 2018-11-25 14:04:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1543154646']
2018-11-25 14:04:04 [INFO    ] Finished spawning TBN in 0.050 s
2018-11-25 14:04:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-11-25 14:04:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 14:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:04:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:04:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:04:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:04:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:04:58 [DEBUG   ] Finished updating board flags in 1.524 seconds
2018-11-25 14:05:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-25 14:05:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 14:05:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:05:48 [DEBUG   ] Got command RPT from MCS: ref #623245
2018-11-25 14:05:48 [DEBUG   ] summary = ERROR
2018-11-25 14:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623245  13 58447 50748397 A  ERRORERROR'
2018-11-25 14:05:48 [DEBUG   ] Got command RPT from MCS: ref #623246
2018-11-25 14:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623246  77 58447 50748398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:05:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:05:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:05:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:05:58 [WARNING ] (13, 1, 'bot')
2018-11-25 14:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:05:58 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-11-25 14:06:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 14:06:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:06:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:06:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:06:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:06:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:06:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:06:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:06:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:06:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:06:59 [DEBUG   ] Finished updating board flags in 2.126 seconds
2018-11-25 14:07:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:07:18 [DEBUG   ] Got command RPT from MCS: ref #623266
2018-11-25 14:07:18 [DEBUG   ] summary = ERROR
2018-11-25 14:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623266  13 58447 50838549 A  ERRORERROR'
2018-11-25 14:07:18 [DEBUG   ] Got command RPT from MCS: ref #623267
2018-11-25 14:07:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623267  77 58447 50838753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:07:18 [DEBUG   ] Got command RPT from MCS: ref #623268
2018-11-25 14:07:18 [DEBUG   ] summary = ERROR
2018-11-25 14:07:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623268  13 58447 50838945 A  ERRORERROR'
2018-11-25 14:07:19 [DEBUG   ] Got command RPT from MCS: ref #623269
2018-11-25 14:07:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623269  77 58447 50839149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:07:19 [DEBUG   ] Got command RPT from MCS: ref #623270
2018-11-25 14:07:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623270  12 58447 50839353 A  ERRORB˜™š'
2018-11-25 14:07:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 14:07:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:07:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:07:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:07:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:07:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:07:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:07:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:07:59 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-25 14:08:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:08:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:08:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 14:08:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:08:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:08:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:08:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:08:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:08:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:08:59 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-11-25 14:09:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 14:09:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:09:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:09:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 14:09:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:09:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:09:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:09:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:09:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:09:59 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-11-25 14:10:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:10:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:10:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:10:48 [DEBUG   ] Got command RPT from MCS: ref #623275
2018-11-25 14:10:48 [DEBUG   ] summary = ERROR
2018-11-25 14:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623275  13 58447 51048405 A  ERRORERROR'
2018-11-25 14:10:48 [DEBUG   ] Got command RPT from MCS: ref #623276
2018-11-25 14:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623276  77 58447 51048406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:10:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:10:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:10:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:10:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:10:59 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-25 14:11:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:11:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 14:11:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:11:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:11:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:11:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:11:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:11:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:11:59 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-11-25 14:12:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 14:12:18 [DEBUG   ] Got command RPT from MCS: ref #623294
2018-11-25 14:12:18 [DEBUG   ] summary = ERROR
2018-11-25 14:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623294  13 58447 51138637 A  ERRORERROR'
2018-11-25 14:12:18 [DEBUG   ] Got command RPT from MCS: ref #623295
2018-11-25 14:12:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:12:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623295  77 58447 51138829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:12:19 [DEBUG   ] Got command RPT from MCS: ref #623296
2018-11-25 14:12:19 [DEBUG   ] summary = ERROR
2018-11-25 14:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623296  13 58447 51139033 A  ERRORERROR'
2018-11-25 14:12:19 [DEBUG   ] Got command RPT from MCS: ref #623298
2018-11-25 14:12:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623298  77 58447 51139237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:12:19 [DEBUG   ] Got command RPT from MCS: ref #623299
2018-11-25 14:12:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623299  12 58447 51139441 A  ERRORB˜™š'
2018-11-25 14:12:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:12:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:12:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 14:12:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:12:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:12:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:12:59 [WARNING ] (13, 1, 'bot')
2018-11-25 14:12:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:12:59 [DEBUG   ] Finished updating board flags in 1.525 seconds
2018-11-25 14:13:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:13:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:13:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:13:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:13:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:14:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:14:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:14:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:14:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:14:00 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-11-25 14:14:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:14:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:14:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 14:14:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:15:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 14:15:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:15:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:15:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:15:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:15:00 [DEBUG   ] Finished updating board flags in 2.144 seconds
2018-11-25 14:15:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:15:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 14:15:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:15:48 [DEBUG   ] Got command RPT from MCS: ref #623312
2018-11-25 14:15:48 [DEBUG   ] summary = ERROR
2018-11-25 14:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623312  13 58447 51348401 A  ERRORERROR'
2018-11-25 14:15:48 [DEBUG   ] Got command RPT from MCS: ref #623313
2018-11-25 14:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623313  77 58447 51348402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:16:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 14:16:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:16:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:16:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:16:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:16:00 [DEBUG   ] Finished updating board flags in 1.883 seconds
2018-11-25 14:16:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 14:16:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:16:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:16:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:17:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:17:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:17:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:17:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:17:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:17:00 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-11-25 14:17:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:17:18 [DEBUG   ] Got command RPT from MCS: ref #623335
2018-11-25 14:17:18 [DEBUG   ] summary = ERROR
2018-11-25 14:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623335  13 58447 51438725 A  ERRORERROR'
2018-11-25 14:17:18 [DEBUG   ] Got command RPT from MCS: ref #623336
2018-11-25 14:17:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623336  77 58447 51438917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:17:19 [DEBUG   ] Got command RPT from MCS: ref #623337
2018-11-25 14:17:19 [DEBUG   ] summary = ERROR
2018-11-25 14:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623337  13 58447 51439121 A  ERRORERROR'
2018-11-25 14:17:19 [DEBUG   ] Got command RPT from MCS: ref #623338
2018-11-25 14:17:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623338  77 58447 51439325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:17:19 [DEBUG   ] Got command RPT from MCS: ref #623339
2018-11-25 14:17:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623339  12 58447 51439529 A  ERRORB˜™š'
2018-11-25 14:17:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:17:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:17:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:17:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:18:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:18:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:18:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:18:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:18:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:18:00 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-25 14:18:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:18:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:18:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 14:18:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:18:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:19:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:19:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:19:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:19:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:19:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:19:00 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-25 14:19:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:19:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 14:19:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 14:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:20:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 14:20:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:20:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:20:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:20:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:20:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:20:00 [DEBUG   ] Finished updating board flags in 1.660 seconds
2018-11-25 14:20:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 14:20:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 14:20:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 14:20:48 [DEBUG   ] Got command RPT from MCS: ref #623349
2018-11-25 14:20:48 [DEBUG   ] summary = ERROR
2018-11-25 14:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623349  13 58447 51648405 A  ERRORERROR'
2018-11-25 14:20:48 [DEBUG   ] Got command RPT from MCS: ref #623350
2018-11-25 14:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623350  77 58447 51648406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:21:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:21:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:21:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:21:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:21:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:21:00 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-11-25 14:21:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 14:21:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 14:21:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-25 14:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:22:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:22:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:22:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:22:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:22:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:22:00 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-11-25 14:22:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 14:22:18 [DEBUG   ] Got command RPT from MCS: ref #623372
2018-11-25 14:22:18 [DEBUG   ] summary = ERROR
2018-11-25 14:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623372  13 58447 51738805 A  ERRORERROR'
2018-11-25 14:22:19 [DEBUG   ] Got command RPT from MCS: ref #623373
2018-11-25 14:22:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623373  77 58447 51739009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:22:19 [DEBUG   ] Got command RPT from MCS: ref #623374
2018-11-25 14:22:19 [DEBUG   ] summary = ERROR
2018-11-25 14:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623374  13 58447 51739213 A  ERRORERROR'
2018-11-25 14:22:19 [DEBUG   ] Got command RPT from MCS: ref #623376
2018-11-25 14:22:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623376  77 58447 51739405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:22:19 [DEBUG   ] Got command RPT from MCS: ref #623377
2018-11-25 14:22:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623377  12 58447 51739609 A  ERRORB™™š'
2018-11-25 14:22:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:22:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:23:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 14:23:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:23:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:23:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:23:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:23:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:23:00 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-25 14:23:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 14:23:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:23:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:24:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:24:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 14:24:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:24:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:24:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:24:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:24:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:24:00 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-11-25 14:24:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:24:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 14:24:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-25 14:25:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:25:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 14:25:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:25:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:25:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:25:00 [WARNING ] (13, 1, 'bot')
2018-11-25 14:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:25:00 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-11-25 14:25:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:25:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 14:25:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 14:25:48 [DEBUG   ] Got command RPT from MCS: ref #623386
2018-11-25 14:25:48 [DEBUG   ] summary = ERROR
2018-11-25 14:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623386  13 58447 51948401 A  ERRORERROR'
2018-11-25 14:25:48 [DEBUG   ] Got command RPT from MCS: ref #623387
2018-11-25 14:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623387  77 58447 51948402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:26:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:26:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:26:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:26:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:26:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:26:01 [DEBUG   ] Finished updating board flags in 2.166 seconds
2018-11-25 14:26:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-25 14:26:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:26:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 14:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:27:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 14:27:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:27:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:27:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:27:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:27:01 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-11-25 14:27:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 14:27:18 [DEBUG   ] Got command RPT from MCS: ref #623403
2018-11-25 14:27:18 [DEBUG   ] summary = ERROR
2018-11-25 14:27:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623403  13 58447 52038901 A  ERRORERROR'
2018-11-25 14:27:19 [DEBUG   ] Got command RPT from MCS: ref #623404
2018-11-25 14:27:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623404  77 58447 52039093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:27:19 [DEBUG   ] Got command RPT from MCS: ref #623405
2018-11-25 14:27:19 [DEBUG   ] summary = ERROR
2018-11-25 14:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623405  13 58447 52039297 A  ERRORERROR'
2018-11-25 14:27:19 [DEBUG   ] Got command RPT from MCS: ref #623406
2018-11-25 14:27:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623406  77 58447 52039501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:27:19 [DEBUG   ] Got command RPT from MCS: ref #623407
2018-11-25 14:27:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623407  12 58447 52039693 A  ERRORB˜™š'
2018-11-25 14:27:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:27:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:28:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:28:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:28:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:28:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:28:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:28:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:28:01 [DEBUG   ] Finished updating board flags in 1.873 seconds
2018-11-25 14:28:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 14:28:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 14:28:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 14:29:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:29:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:29:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:29:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:29:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:29:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:29:01 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-25 14:29:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:29:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:29:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 14:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:30:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:30:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:30:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:30:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:30:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:30:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:30:01 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-25 14:30:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:30:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 14:30:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:30:48 [DEBUG   ] Got command RPT from MCS: ref #623416
2018-11-25 14:30:48 [DEBUG   ] summary = ERROR
2018-11-25 14:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623416  13 58447 52248409 A  ERRORERROR'
2018-11-25 14:30:48 [DEBUG   ] Got command RPT from MCS: ref #623417
2018-11-25 14:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623417  77 58447 52248410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:31:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:31:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 14:31:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:31:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:31:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:31:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:31:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:31:01 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-25 14:31:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 14:31:26 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-25 14:31:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 14:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:32:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:32:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:32:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:32:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:32:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:32:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:32:01 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-11-25 14:32:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 14:32:18 [DEBUG   ] Got command RPT from MCS: ref #623435
2018-11-25 14:32:18 [DEBUG   ] summary = ERROR
2018-11-25 14:32:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623435  13 58447 52338985 A  ERRORERROR'
2018-11-25 14:32:19 [DEBUG   ] Got command RPT from MCS: ref #623436
2018-11-25 14:32:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:32:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623436  77 58447 52339177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:32:19 [DEBUG   ] Got command RPT from MCS: ref #623437
2018-11-25 14:32:19 [DEBUG   ] summary = ERROR
2018-11-25 14:32:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623437  13 58447 52339381 A  ERRORERROR'
2018-11-25 14:32:19 [DEBUG   ] Got command RPT from MCS: ref #623439
2018-11-25 14:32:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:32:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623439  77 58447 52339585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:32:19 [DEBUG   ] Got command RPT from MCS: ref #623441
2018-11-25 14:32:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:32:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623441  12 58447 52339789 A  ERRORB˜™š'
2018-11-25 14:32:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 14:32:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 14:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:33:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:33:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:33:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:33:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:33:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:33:01 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-11-25 14:33:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 14:33:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 14:33:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 14:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 14:34:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:34:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:34:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:34:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:34:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:34:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:34:01 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-11-25 14:34:06 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-25 14:34:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 14:34:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-25 14:35:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:35:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:35:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:35:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:35:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:35:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:35:01 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-11-25 14:35:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 14:35:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-25 14:35:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 14:35:48 [DEBUG   ] Got command RPT from MCS: ref #623449
2018-11-25 14:35:48 [DEBUG   ] summary = ERROR
2018-11-25 14:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623449  13 58447 52548405 A  ERRORERROR'
2018-11-25 14:35:48 [DEBUG   ] Got command RPT from MCS: ref #623450
2018-11-25 14:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623450  77 58447 52548406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:36:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:36:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:36:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:36:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:36:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:36:01 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-11-25 14:36:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 14:36:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:36:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:37:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:37:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:37:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:37:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:37:01 [WARNING ] (13, 1, 'bot')
2018-11-25 14:37:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:37:01 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-11-25 14:37:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-25 14:37:19 [DEBUG   ] Got command RPT from MCS: ref #623470
2018-11-25 14:37:19 [DEBUG   ] summary = ERROR
2018-11-25 14:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623470  13 58447 52639065 A  ERRORERROR'
2018-11-25 14:37:19 [DEBUG   ] Got command RPT from MCS: ref #623471
2018-11-25 14:37:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623471  77 58447 52639269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:37:19 [DEBUG   ] Got command RPT from MCS: ref #623472
2018-11-25 14:37:19 [DEBUG   ] summary = ERROR
2018-11-25 14:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623472  13 58447 52639473 A  ERRORERROR'
2018-11-25 14:37:19 [DEBUG   ] Got command RPT from MCS: ref #623473
2018-11-25 14:37:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623473  77 58447 52639665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:37:19 [DEBUG   ] Got command RPT from MCS: ref #623474
2018-11-25 14:37:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:37:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623474  12 58447 52639869 A  ERRORB˜™š'
2018-11-25 14:37:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 14:37:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 14:38:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:38:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:38:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:38:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:38:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:38:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:38:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:38:02 [DEBUG   ] Finished updating board flags in 2.155 seconds
2018-11-25 14:38:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:38:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 14:38:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 14:39:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:39:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:39:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:39:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:39:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:39:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:39:02 [DEBUG   ] Finished updating board flags in 2.099 seconds
2018-11-25 14:39:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 14:39:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-25 14:39:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 14:40:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 14:40:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:40:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:40:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:40:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:40:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:40:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:40:02 [DEBUG   ] Finished updating board flags in 1.901 seconds
2018-11-25 14:40:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 14:40:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 14:40:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 14:40:48 [DEBUG   ] Got command RPT from MCS: ref #623479
2018-11-25 14:40:48 [DEBUG   ] summary = ERROR
2018-11-25 14:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623479  13 58447 52848405 A  ERRORERROR'
2018-11-25 14:40:48 [DEBUG   ] Got command RPT from MCS: ref #623480
2018-11-25 14:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623480  77 58447 52848406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:41:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:41:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:41:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:41:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:41:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:41:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:41:02 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-25 14:41:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:41:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:41:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 14:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:42:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:42:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:42:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:42:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:42:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:42:02 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-25 14:42:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 14:42:19 [DEBUG   ] Got command RPT from MCS: ref #623498
2018-11-25 14:42:19 [DEBUG   ] summary = ERROR
2018-11-25 14:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623498  13 58447 52939157 A  ERRORERROR'
2018-11-25 14:42:19 [DEBUG   ] Got command RPT from MCS: ref #623499
2018-11-25 14:42:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623499  77 58447 52939349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:42:19 [DEBUG   ] Got command RPT from MCS: ref #623500
2018-11-25 14:42:19 [DEBUG   ] summary = ERROR
2018-11-25 14:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623500  13 58447 52939553 A  ERRORERROR'
2018-11-25 14:42:19 [DEBUG   ] Got command RPT from MCS: ref #623502
2018-11-25 14:42:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623502  77 58447 52939757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:42:19 [DEBUG   ] Got command RPT from MCS: ref #623503
2018-11-25 14:42:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623503  12 58447 52939961 A  ERRORB˜™š'
2018-11-25 14:42:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 14:42:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:43:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:43:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:43:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:43:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:43:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:43:02 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-11-25 14:43:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:43:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 14:43:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:44:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:44:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:44:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:44:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:44:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:44:02 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-11-25 14:44:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:44:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:44:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:45:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:45:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:45:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:45:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:45:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:45:02 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-25 14:45:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:45:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:45:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:45:48 [DEBUG   ] Got command RPT from MCS: ref #623516
2018-11-25 14:45:48 [DEBUG   ] summary = ERROR
2018-11-25 14:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623516  13 58447 53148405 A  ERRORERROR'
2018-11-25 14:45:48 [DEBUG   ] Got command RPT from MCS: ref #623517
2018-11-25 14:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623517  77 58447 53148406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:46:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:46:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:46:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:46:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:46:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:46:02 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-11-25 14:46:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 14:46:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:46:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:47:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:47:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:47:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:47:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:47:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:47:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:47:02 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-11-25 14:47:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:47:19 [DEBUG   ] Got command RPT from MCS: ref #623533
2018-11-25 14:47:19 [DEBUG   ] summary = ERROR
2018-11-25 14:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623533  13 58447 53239245 A  ERRORERROR'
2018-11-25 14:47:19 [DEBUG   ] Got command RPT from MCS: ref #623534
2018-11-25 14:47:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623534  77 58447 53239437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:47:19 [DEBUG   ] Got command RPT from MCS: ref #623535
2018-11-25 14:47:19 [DEBUG   ] summary = ERROR
2018-11-25 14:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623535  13 58447 53239641 A  ERRORERROR'
2018-11-25 14:47:19 [DEBUG   ] Got command RPT from MCS: ref #623536
2018-11-25 14:47:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623536  77 58447 53239845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:47:20 [DEBUG   ] Got command RPT from MCS: ref #623537
2018-11-25 14:47:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623537  12 58447 53240037 A  ERRORB˜™š'
2018-11-25 14:47:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:47:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:48:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:48:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:48:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:48:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:48:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:48:02 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-11-25 14:48:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:48:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:48:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 14:49:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:49:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:49:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:49:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:49:02 [WARNING ] (13, 1, 'bot')
2018-11-25 14:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:49:02 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-11-25 14:49:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:49:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 14:49:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 14:50:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:50:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 14:50:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 14:50:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:50:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:50:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:50:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:50:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:50:03 [DEBUG   ] Finished updating board flags in 2.227 seconds
2018-11-25 14:50:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 14:50:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 14:50:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:50:48 [DEBUG   ] Got command RPT from MCS: ref #623542
2018-11-25 14:50:48 [DEBUG   ] summary = ERROR
2018-11-25 14:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623542  13 58447 53448413 A  ERRORERROR'
2018-11-25 14:50:48 [DEBUG   ] Got command RPT from MCS: ref #623543
2018-11-25 14:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623543  77 58447 53448414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:51:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:51:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:51:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:51:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:51:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:51:03 [DEBUG   ] Finished updating board flags in 2.159 seconds
2018-11-25 14:51:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:51:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:51:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 14:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:52:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:52:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:52:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:52:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:52:03 [DEBUG   ] Finished updating board flags in 2.104 seconds
2018-11-25 14:52:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 14:52:19 [DEBUG   ] Got command RPT from MCS: ref #623565
2018-11-25 14:52:19 [DEBUG   ] summary = ERROR
2018-11-25 14:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623565  13 58447 53539325 A  ERRORERROR'
2018-11-25 14:52:19 [DEBUG   ] Got command RPT from MCS: ref #623566
2018-11-25 14:52:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623566  77 58447 53539529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:52:19 [DEBUG   ] Got command RPT from MCS: ref #623567
2018-11-25 14:52:19 [DEBUG   ] summary = ERROR
2018-11-25 14:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623567  13 58447 53539721 A  ERRORERROR'
2018-11-25 14:52:19 [DEBUG   ] Got command RPT from MCS: ref #623569
2018-11-25 14:52:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:52:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623569  77 58447 53539925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:52:20 [DEBUG   ] Got command RPT from MCS: ref #623570
2018-11-25 14:52:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623570  12 58447 53540129 A  ERRORB˜™š'
2018-11-25 14:52:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 14:52:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 14:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:53:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:53:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:53:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:53:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:53:03 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-11-25 14:53:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 14:53:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 14:53:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 14:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:54:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:54:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:54:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:54:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:54:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:54:03 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-11-25 14:54:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 14:54:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 14:54:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 14:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:55:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:55:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:55:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:55:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:55:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:55:03 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-11-25 14:55:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 14:55:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 14:55:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 14:55:48 [DEBUG   ] Got command RPT from MCS: ref #623579
2018-11-25 14:55:48 [DEBUG   ] summary = ERROR
2018-11-25 14:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623579  13 58447 53748417 A  ERRORERROR'
2018-11-25 14:55:48 [DEBUG   ] Got command RPT from MCS: ref #623580
2018-11-25 14:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623580  77 58447 53748418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:56:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 14:56:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:56:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:56:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:56:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:56:03 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-25 14:56:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 14:56:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 14:56:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 14:57:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:57:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:57:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:57:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:57:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:57:03 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-11-25 14:57:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:57:19 [DEBUG   ] Got command RPT from MCS: ref #623596
2018-11-25 14:57:19 [DEBUG   ] summary = ERROR
2018-11-25 14:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623596  13 58447 53839409 A  ERRORERROR'
2018-11-25 14:57:19 [DEBUG   ] Got command RPT from MCS: ref #623597
2018-11-25 14:57:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623597  77 58447 53839613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:57:19 [DEBUG   ] Got command RPT from MCS: ref #623598
2018-11-25 14:57:19 [DEBUG   ] summary = ERROR
2018-11-25 14:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623598  13 58447 53839817 A  ERRORERROR'
2018-11-25 14:57:20 [DEBUG   ] Got command RPT from MCS: ref #623599
2018-11-25 14:57:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 14:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623599  77 58447 53840010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 14:57:20 [DEBUG   ] Got command RPT from MCS: ref #623600
2018-11-25 14:57:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 14:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623600  12 58447 53840213 A  ERRORB˜™š'
2018-11-25 14:57:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:57:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 14:58:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:58:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 14:58:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:58:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:58:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:58:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:58:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:58:03 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-11-25 14:58:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 14:58:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-25 14:58:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 14:59:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 14:59:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:59:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:59:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:59:03 [WARNING ] (13, 1, 'bot')
2018-11-25 14:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 14:59:03 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-11-25 14:59:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 14:59:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 14:59:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:00:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:00:03 [WARNING ] (13, 1, 'bot')
2018-11-25 15:00:03 [WARNING ] (13, 1, 'bot')
2018-11-25 15:00:03 [WARNING ] (13, 1, 'bot')
2018-11-25 15:00:03 [WARNING ] (13, 1, 'bot')
2018-11-25 15:00:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:00:03 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-11-25 15:00:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:00:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:00:48 [DEBUG   ] Got command RPT from MCS: ref #623609
2018-11-25 15:00:48 [DEBUG   ] summary = ERROR
2018-11-25 15:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623609  13 58447 54048417 A  ERRORERROR'
2018-11-25 15:00:48 [DEBUG   ] Got command RPT from MCS: ref #623610
2018-11-25 15:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623610  77 58447 54048418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:00:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:01:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:01:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:01:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:01:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:01:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:01:04 [DEBUG   ] Finished updating board flags in 2.140 seconds
2018-11-25 15:01:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:01:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:01:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:02:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 15:02:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 15:02:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:02:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:02:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:02:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:02:04 [DEBUG   ] Finished updating board flags in 1.941 seconds
2018-11-25 15:02:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 15:02:19 [DEBUG   ] Got command RPT from MCS: ref #623628
2018-11-25 15:02:19 [DEBUG   ] summary = ERROR
2018-11-25 15:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623628  13 58447 54139501 A  ERRORERROR'
2018-11-25 15:02:19 [DEBUG   ] Got command RPT from MCS: ref #623629
2018-11-25 15:02:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623629  77 58447 54139693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:02:19 [DEBUG   ] Got command RPT from MCS: ref #623630
2018-11-25 15:02:19 [DEBUG   ] summary = ERROR
2018-11-25 15:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623630  13 58447 54139897 A  ERRORERROR'
2018-11-25 15:02:20 [DEBUG   ] Got command RPT from MCS: ref #623632
2018-11-25 15:02:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623632  77 58447 54140101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:02:20 [DEBUG   ] Got command RPT from MCS: ref #623633
2018-11-25 15:02:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623633  12 58447 54140305 A  ERRORB˜™š'
2018-11-25 15:02:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:02:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:03:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:03:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:03:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:03:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:03:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:03:04 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-11-25 15:03:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:03:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 15:03:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 15:04:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 15:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:04:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:04:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:04:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:04:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:04:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:04:04 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-25 15:04:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 15:04:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:04:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 15:05:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:05:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:05:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:05:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:05:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:05:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:05:04 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-11-25 15:05:10 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-25 15:05:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 15:05:48 [DEBUG   ] Got command RPT from MCS: ref #623642
2018-11-25 15:05:48 [DEBUG   ] summary = ERROR
2018-11-25 15:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623642  13 58447 54348417 A  ERRORERROR'
2018-11-25 15:05:48 [DEBUG   ] Got command RPT from MCS: ref #623643
2018-11-25 15:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623643  77 58447 54348418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:05:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 15:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:06:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:06:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:06:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:06:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:06:04 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-25 15:06:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:06:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:06:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:07:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 15:07:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:07:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:07:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:07:04 [WARNING ] (13, 1, 'bot')
2018-11-25 15:07:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:07:04 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-25 15:07:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:07:19 [DEBUG   ] Got command RPT from MCS: ref #623663
2018-11-25 15:07:19 [DEBUG   ] summary = ERROR
2018-11-25 15:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623663  13 58447 54439581 A  ERRORERROR'
2018-11-25 15:07:19 [DEBUG   ] Got command RPT from MCS: ref #623664
2018-11-25 15:07:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623664  77 58447 54439791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:07:19 [DEBUG   ] Got command RPT from MCS: ref #623665
2018-11-25 15:07:19 [DEBUG   ] summary = ERROR
2018-11-25 15:07:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623665  13 58447 54439981 A  ERRORERROR'
2018-11-25 15:07:20 [DEBUG   ] Got command RPT from MCS: ref #623666
2018-11-25 15:07:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623666  77 58447 54440185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:07:20 [DEBUG   ] Got command RPT from MCS: ref #623667
2018-11-25 15:07:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623667  12 58447 54440389 A  ERRORB™™š'
2018-11-25 15:07:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:07:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:08:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:08:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:08:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:08:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:08:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:08:05 [DEBUG   ] Finished updating board flags in 2.087 seconds
2018-11-25 15:08:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:08:30 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-25 15:08:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 15:09:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:09:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:09:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:09:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:09:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:09:05 [DEBUG   ] Finished updating board flags in 1.949 seconds
2018-11-25 15:09:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 15:09:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:09:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 15:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:10:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:10:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:10:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:10:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:10:05 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-25 15:10:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 15:10:31 [DEBUG   ] Finished updating ant stats in 1.803 seconds
2018-11-25 15:10:48 [DEBUG   ] Got command RPT from MCS: ref #623672
2018-11-25 15:10:48 [DEBUG   ] summary = ERROR
2018-11-25 15:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623672  13 58447 54648417 A  ERRORERROR'
2018-11-25 15:10:48 [DEBUG   ] Got command RPT from MCS: ref #623673
2018-11-25 15:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623673  77 58447 54648418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:10:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:11:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:11:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:11:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:11:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:11:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:11:05 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-11-25 15:11:10 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-11-25 15:11:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 15:11:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 15:12:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:12:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:12:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:12:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:12:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:12:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:12:05 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-25 15:12:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:12:19 [DEBUG   ] Got command RPT from MCS: ref #623691
2018-11-25 15:12:19 [DEBUG   ] summary = ERROR
2018-11-25 15:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623691  13 58447 54739669 A  ERRORERROR'
2018-11-25 15:12:19 [DEBUG   ] Got command RPT from MCS: ref #623692
2018-11-25 15:12:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623692  77 58447 54739873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:12:20 [DEBUG   ] Got command RPT from MCS: ref #623693
2018-11-25 15:12:20 [DEBUG   ] summary = ERROR
2018-11-25 15:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623693  13 58447 54740065 A  ERRORERROR'
2018-11-25 15:12:20 [DEBUG   ] Got command RPT from MCS: ref #623695
2018-11-25 15:12:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623695  77 58447 54740269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:12:20 [DEBUG   ] Got command RPT from MCS: ref #623697
2018-11-25 15:12:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623697  12 58447 54740473 A  ERRORB˜™š'
2018-11-25 15:12:31 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-11-25 15:12:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 15:13:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:13:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:13:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:13:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:13:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:13:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:13:05 [DEBUG   ] Finished updating board flags in 1.675 seconds
2018-11-25 15:13:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:13:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:13:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 15:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:14:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:14:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:14:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:14:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:14:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:14:05 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-25 15:14:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 15:14:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:14:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-25 15:15:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:15:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:15:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:15:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:15:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:15:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:15:05 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-11-25 15:15:10 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-25 15:15:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 15:15:48 [DEBUG   ] Got command RPT from MCS: ref #623709
2018-11-25 15:15:48 [DEBUG   ] summary = ERROR
2018-11-25 15:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623709  13 58447 54948421 A  ERRORERROR'
2018-11-25 15:15:48 [DEBUG   ] Got command RPT from MCS: ref #623710
2018-11-25 15:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623710  77 58447 54948422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:15:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 15:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:16:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:16:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:16:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:16:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:16:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:16:05 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-11-25 15:16:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 15:16:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 15:16:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 15:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:17:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:17:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:17:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:17:05 [WARNING ] (13, 1, 'bot')
2018-11-25 15:17:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:17:05 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-11-25 15:17:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 15:17:19 [DEBUG   ] Got command RPT from MCS: ref #623726
2018-11-25 15:17:19 [DEBUG   ] summary = ERROR
2018-11-25 15:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623726  13 58447 55039757 A  ERRORERROR'
2018-11-25 15:17:19 [DEBUG   ] Got command RPT from MCS: ref #623727
2018-11-25 15:17:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623727  77 58447 55039949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:17:20 [DEBUG   ] Got command RPT from MCS: ref #623728
2018-11-25 15:17:20 [DEBUG   ] summary = ERROR
2018-11-25 15:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623728  13 58447 55040153 A  ERRORERROR'
2018-11-25 15:17:20 [DEBUG   ] Got command RPT from MCS: ref #623729
2018-11-25 15:17:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623729  77 58447 55040357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:17:20 [DEBUG   ] Got command RPT from MCS: ref #623730
2018-11-25 15:17:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623730  12 58447 55040561 A  ERRORB˜™š'
2018-11-25 15:17:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 15:17:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 15:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:18:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 15:18:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:18:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:18:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:18:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:18:06 [DEBUG   ] Finished updating board flags in 2.216 seconds
2018-11-25 15:18:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 15:18:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 15:18:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 15:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 15:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:19:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:19:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:19:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:19:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:19:06 [DEBUG   ] Finished updating board flags in 2.156 seconds
2018-11-25 15:19:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:19:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:19:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:20:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:20:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:20:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:20:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:20:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:20:06 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-11-25 15:20:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 15:20:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 15:20:48 [DEBUG   ] Got command RPT from MCS: ref #623735
2018-11-25 15:20:48 [DEBUG   ] summary = ERROR
2018-11-25 15:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623735  13 58447 55248421 A  ERRORERROR'
2018-11-25 15:20:48 [DEBUG   ] Got command RPT from MCS: ref #623736
2018-11-25 15:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623736  77 58447 55248422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:20:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:21:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:21:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:21:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:21:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:21:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:21:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:21:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:21:06 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-11-25 15:21:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:21:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 15:21:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:22:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:22:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:22:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:22:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:22:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:22:06 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-11-25 15:22:11 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-11-25 15:22:19 [DEBUG   ] Got command RPT from MCS: ref #623758
2018-11-25 15:22:19 [DEBUG   ] summary = ERROR
2018-11-25 15:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623758  13 58447 55339841 A  ERRORERROR'
2018-11-25 15:22:20 [DEBUG   ] Got command RPT from MCS: ref #623759
2018-11-25 15:22:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623759  77 58447 55340045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:22:20 [DEBUG   ] Got command RPT from MCS: ref #623760
2018-11-25 15:22:20 [DEBUG   ] summary = ERROR
2018-11-25 15:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623760  13 58447 55340237 A  ERRORERROR'
2018-11-25 15:22:20 [DEBUG   ] Got command RPT from MCS: ref #623762
2018-11-25 15:22:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623762  77 58447 55340446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:22:20 [DEBUG   ] Got command RPT from MCS: ref #623764
2018-11-25 15:22:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623764  12 58447 55340646 A  ERRORB˜™š'
2018-11-25 15:22:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 15:22:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 15:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:23:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:23:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:23:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:23:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:23:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:23:06 [DEBUG   ] Finished updating board flags in 1.738 seconds
2018-11-25 15:23:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 15:23:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:23:51 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 15:24:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:24:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:24:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:24:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:24:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:24:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:24:06 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-11-25 15:24:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 15:24:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 15:24:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 15:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:25:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:25:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:25:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:25:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:25:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:25:06 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-25 15:25:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 15:25:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:25:48 [DEBUG   ] Got command RPT from MCS: ref #623772
2018-11-25 15:25:48 [DEBUG   ] summary = ERROR
2018-11-25 15:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623772  13 58447 55548417 A  ERRORERROR'
2018-11-25 15:25:48 [DEBUG   ] Got command RPT from MCS: ref #623773
2018-11-25 15:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623773  77 58447 55548418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:25:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:26:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:26:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 15:26:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:26:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:26:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:26:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:26:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:26:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:26:06 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-11-25 15:26:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:26:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 15:26:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:27:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:27:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:27:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:27:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:27:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:27:06 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-11-25 15:27:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:27:19 [DEBUG   ] Got command RPT from MCS: ref #623789
2018-11-25 15:27:19 [DEBUG   ] summary = ERROR
2018-11-25 15:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623789  13 58447 55639921 A  ERRORERROR'
2018-11-25 15:27:20 [DEBUG   ] Got command RPT from MCS: ref #623790
2018-11-25 15:27:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623790  77 58447 55640125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:27:20 [DEBUG   ] Got command RPT from MCS: ref #623791
2018-11-25 15:27:20 [DEBUG   ] summary = ERROR
2018-11-25 15:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623791  13 58447 55640329 A  ERRORERROR'
2018-11-25 15:27:20 [DEBUG   ] Got command RPT from MCS: ref #623792
2018-11-25 15:27:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623792  77 58447 55640533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:27:20 [DEBUG   ] Got command RPT from MCS: ref #623793
2018-11-25 15:27:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623793  12 58447 55640725 A  ERRORB˜™š'
2018-11-25 15:27:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 15:27:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:28:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:28:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 15:28:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:28:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:28:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:28:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:28:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:28:06 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-11-25 15:28:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:28:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:28:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 15:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:29:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:29:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:29:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:29:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:29:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:29:06 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-11-25 15:29:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:29:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:29:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:30:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:30:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:30:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:30:06 [WARNING ] (13, 1, 'bot')
2018-11-25 15:30:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:30:06 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-11-25 15:30:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 15:30:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 15:30:48 [DEBUG   ] Got command RPT from MCS: ref #623802
2018-11-25 15:30:48 [DEBUG   ] summary = ERROR
2018-11-25 15:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623802  13 58447 55848425 A  ERRORERROR'
2018-11-25 15:30:48 [DEBUG   ] Got command RPT from MCS: ref #623803
2018-11-25 15:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623803  77 58447 55848426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:30:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 15:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:31:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:31:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:31:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:31:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:31:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:31:07 [DEBUG   ] Finished updating board flags in 2.203 seconds
2018-11-25 15:31:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:31:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 15:31:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 15:32:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:32:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:32:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:32:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:32:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:32:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:32:07 [DEBUG   ] Finished updating board flags in 2.215 seconds
2018-11-25 15:32:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 15:32:20 [DEBUG   ] Got command RPT from MCS: ref #623821
2018-11-25 15:32:20 [DEBUG   ] summary = ERROR
2018-11-25 15:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623821  13 58447 55940009 A  ERRORERROR'
2018-11-25 15:32:20 [DEBUG   ] Got command RPT from MCS: ref #623822
2018-11-25 15:32:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623822  77 58447 55940213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:32:20 [DEBUG   ] Got command RPT from MCS: ref #623823
2018-11-25 15:32:20 [DEBUG   ] summary = ERROR
2018-11-25 15:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623823  13 58447 55940417 A  ERRORERROR'
2018-11-25 15:32:20 [DEBUG   ] Got command RPT from MCS: ref #623825
2018-11-25 15:32:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623825  77 58447 55940609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:32:20 [DEBUG   ] Got command RPT from MCS: ref #623827
2018-11-25 15:32:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:32:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623827  12 58447 55940813 A  ERRORB™™š'
2018-11-25 15:32:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 15:32:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:33:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 15:33:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:33:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:33:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:33:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:33:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:33:07 [DEBUG   ] Finished updating board flags in 2.176 seconds
2018-11-25 15:33:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:33:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:33:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 15:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:34:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:34:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:34:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:34:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:34:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:34:07 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-11-25 15:34:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:34:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:34:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:35:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:35:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:35:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:35:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:35:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:35:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:35:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:35:07 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-25 15:35:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 15:35:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:35:48 [DEBUG   ] Got command RPT from MCS: ref #623835
2018-11-25 15:35:48 [DEBUG   ] summary = ERROR
2018-11-25 15:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623835  13 58447 56148425 A  ERRORERROR'
2018-11-25 15:35:48 [DEBUG   ] Got command RPT from MCS: ref #623836
2018-11-25 15:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623836  77 58447 56148426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:35:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:36:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:36:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:36:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:36:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:36:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:36:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:36:07 [DEBUG   ] Finished updating board flags in 1.950 seconds
2018-11-25 15:36:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:36:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 15:36:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 15:37:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:37:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:37:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:37:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:37:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:37:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:37:07 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-25 15:37:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 15:37:20 [DEBUG   ] Got command RPT from MCS: ref #623856
2018-11-25 15:37:20 [DEBUG   ] summary = ERROR
2018-11-25 15:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623856  13 58447 56240097 A  ERRORERROR'
2018-11-25 15:37:20 [DEBUG   ] Got command RPT from MCS: ref #623857
2018-11-25 15:37:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623857  77 58447 56240301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:37:20 [DEBUG   ] Got command RPT from MCS: ref #623858
2018-11-25 15:37:20 [DEBUG   ] summary = ERROR
2018-11-25 15:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623858  13 58447 56240505 A  ERRORERROR'
2018-11-25 15:37:20 [DEBUG   ] Got command RPT from MCS: ref #623859
2018-11-25 15:37:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623859  77 58447 56240697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:37:20 [DEBUG   ] Got command RPT from MCS: ref #623860
2018-11-25 15:37:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623860  12 58447 56240901 A  ERRORB˜™š'
2018-11-25 15:37:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:37:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 15:38:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:38:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:38:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:38:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:38:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:38:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:38:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:38:07 [DEBUG   ] Finished updating board flags in 1.768 seconds
2018-11-25 15:38:14 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 15:38:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 15:38:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-25 15:39:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:39:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:39:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:39:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:39:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:39:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:39:07 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-25 15:39:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 15:39:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 15:39:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 15:40:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:40:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:40:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:40:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:40:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:40:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:40:07 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-11-25 15:40:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 15:40:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:40:48 [DEBUG   ] Got command RPT from MCS: ref #623865
2018-11-25 15:40:48 [DEBUG   ] summary = ERROR
2018-11-25 15:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623865  13 58447 56448425 A  ERRORERROR'
2018-11-25 15:40:48 [DEBUG   ] Got command RPT from MCS: ref #623866
2018-11-25 15:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623866  77 58447 56448426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:40:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:41:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:41:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:41:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:41:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:41:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:41:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:41:07 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-25 15:41:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-25 15:41:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:41:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:42:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:42:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:42:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:42:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:42:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:42:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:42:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:42:07 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-25 15:42:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 15:42:20 [DEBUG   ] Got command RPT from MCS: ref #623884
2018-11-25 15:42:20 [DEBUG   ] summary = ERROR
2018-11-25 15:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623884  13 58447 56540177 A  ERRORERROR'
2018-11-25 15:42:20 [DEBUG   ] Got command RPT from MCS: ref #623885
2018-11-25 15:42:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623885  77 58447 56540381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:42:20 [DEBUG   ] Got command RPT from MCS: ref #623886
2018-11-25 15:42:20 [DEBUG   ] summary = ERROR
2018-11-25 15:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623886  13 58447 56540585 A  ERRORERROR'
2018-11-25 15:42:20 [DEBUG   ] Got command RPT from MCS: ref #623888
2018-11-25 15:42:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623888  77 58447 56540777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:42:20 [DEBUG   ] Got command RPT from MCS: ref #623890
2018-11-25 15:42:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623890  12 58447 56540981 A  ERRORB™™š'
2018-11-25 15:42:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:42:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:43:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:43:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:43:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:43:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:43:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:43:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:43:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:43:07 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-11-25 15:43:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:43:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 15:43:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:44:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:44:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:44:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:44:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:44:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:44:07 [WARNING ] (13, 1, 'bot')
2018-11-25 15:44:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:44:07 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-11-25 15:44:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-25 15:44:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 15:44:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:45:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:45:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:45:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:45:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:45:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:45:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:45:08 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-11-25 15:45:14 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2018-11-25 15:45:35 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2018-11-25 15:45:48 [DEBUG   ] Got command RPT from MCS: ref #623902
2018-11-25 15:45:48 [DEBUG   ] summary = ERROR
2018-11-25 15:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623902  13 58447 56748425 A  ERRORERROR'
2018-11-25 15:45:48 [DEBUG   ] Got command RPT from MCS: ref #623903
2018-11-25 15:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623903  77 58447 56748426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:45:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 15:46:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:46:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:46:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:46:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:46:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:46:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:46:08 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-11-25 15:46:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 15:46:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 15:46:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:47:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:47:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 15:47:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:47:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:47:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:47:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:47:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:47:08 [DEBUG   ] Finished updating board flags in 1.934 seconds
2018-11-25 15:47:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:47:20 [DEBUG   ] Got command RPT from MCS: ref #623919
2018-11-25 15:47:20 [DEBUG   ] summary = ERROR
2018-11-25 15:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623919  13 58447 56840261 A  ERRORERROR'
2018-11-25 15:47:20 [DEBUG   ] Got command RPT from MCS: ref #623920
2018-11-25 15:47:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623920  77 58447 56840465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:47:20 [DEBUG   ] Got command RPT from MCS: ref #623921
2018-11-25 15:47:20 [DEBUG   ] summary = ERROR
2018-11-25 15:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623921  13 58447 56840669 A  ERRORERROR'
2018-11-25 15:47:20 [DEBUG   ] Got command RPT from MCS: ref #623922
2018-11-25 15:47:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623922  77 58447 56840873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:47:21 [DEBUG   ] Got command RPT from MCS: ref #623923
2018-11-25 15:47:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623923  12 58447 56841065 A  ERRORB˜™š'
2018-11-25 15:47:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 15:47:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 15:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:48:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:48:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:48:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:48:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:48:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:48:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:48:08 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-25 15:48:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:48:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:48:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 15:49:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 15:49:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:49:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:49:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:49:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:49:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:49:08 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-11-25 15:49:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 15:49:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 15:49:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:50:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:50:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:50:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:50:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:50:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:50:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:50:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:50:08 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-11-25 15:50:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 15:50:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 15:50:48 [DEBUG   ] Got command RPT from MCS: ref #623928
2018-11-25 15:50:48 [DEBUG   ] summary = ERROR
2018-11-25 15:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623928  13 58447 57048429 A  ERRORERROR'
2018-11-25 15:50:48 [DEBUG   ] Got command RPT from MCS: ref #623929
2018-11-25 15:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623929  77 58447 57048430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:50:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 15:51:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:51:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:51:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:51:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:51:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:51:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:51:08 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-25 15:51:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:51:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 15:51:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 15:52:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:52:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:52:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:52:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:52:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:52:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:52:08 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-11-25 15:52:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 15:52:20 [DEBUG   ] Got command RPT from MCS: ref #623951
2018-11-25 15:52:20 [DEBUG   ] summary = ERROR
2018-11-25 15:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623951  13 58447 57140357 A  ERRORERROR'
2018-11-25 15:52:20 [DEBUG   ] Got command RPT from MCS: ref #623952
2018-11-25 15:52:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623952  77 58447 57140549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:52:20 [DEBUG   ] Got command RPT from MCS: ref #623953
2018-11-25 15:52:20 [DEBUG   ] summary = ERROR
2018-11-25 15:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623953  13 58447 57140753 A  ERRORERROR'
2018-11-25 15:52:20 [DEBUG   ] Got command RPT from MCS: ref #623955
2018-11-25 15:52:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623955  77 58447 57140957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:52:21 [DEBUG   ] Got command RPT from MCS: ref #623957
2018-11-25 15:52:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623957  12 58447 57141161 A  ERRORB™™š'
2018-11-25 15:52:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 15:52:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 15:53:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:53:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:53:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:53:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:53:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:53:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:53:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:53:08 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-11-25 15:53:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 15:53:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 15:53:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 15:54:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:54:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:54:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:54:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:54:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:54:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:54:08 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-25 15:54:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:54:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:54:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 15:55:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:55:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:55:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:55:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:55:08 [WARNING ] (13, 1, 'bot')
2018-11-25 15:55:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:55:08 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-25 15:55:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:55:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:55:48 [DEBUG   ] Got command RPT from MCS: ref #623965
2018-11-25 15:55:48 [DEBUG   ] summary = ERROR
2018-11-25 15:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623965  13 58447 57348425 A  ERRORERROR'
2018-11-25 15:55:48 [DEBUG   ] Got command RPT from MCS: ref #623966
2018-11-25 15:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623966  77 58447 57348426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:55:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 15:56:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:56:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:56:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:56:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:56:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:56:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:56:09 [DEBUG   ] Finished updating board flags in 2.082 seconds
2018-11-25 15:56:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:56:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 15:56:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 15:57:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:57:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:57:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:57:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:57:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:57:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:57:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:57:09 [DEBUG   ] Finished updating board flags in 1.936 seconds
2018-11-25 15:57:16 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-25 15:57:20 [DEBUG   ] Got command RPT from MCS: ref #623982
2018-11-25 15:57:20 [DEBUG   ] summary = ERROR
2018-11-25 15:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623982  13 58447 57440441 A  ERRORERROR'
2018-11-25 15:57:20 [DEBUG   ] Got command RPT from MCS: ref #623983
2018-11-25 15:57:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623983  77 58447 57440645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:57:20 [DEBUG   ] Got command RPT from MCS: ref #623984
2018-11-25 15:57:20 [DEBUG   ] summary = ERROR
2018-11-25 15:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623984  13 58447 57440837 A  ERRORERROR'
2018-11-25 15:57:21 [DEBUG   ] Got command RPT from MCS: ref #623985
2018-11-25 15:57:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 15:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623985  77 58447 57441041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 15:57:21 [DEBUG   ] Got command RPT from MCS: ref #623986
2018-11-25 15:57:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 15:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623986  12 58447 57441245 A  ERRORB™™š'
2018-11-25 15:57:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 15:57:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 15:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 15:58:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:58:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:58:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:58:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:58:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:58:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:58:09 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-25 15:58:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 15:58:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 15:58:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 15:59:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 15:59:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:59:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:59:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:59:09 [WARNING ] (13, 1, 'bot')
2018-11-25 15:59:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 15:59:09 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-25 15:59:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 15:59:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 15:59:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 16:00:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:00:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:00:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:00:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:00:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:00:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:00:09 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-25 16:00:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 16:00:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:00:48 [DEBUG   ] Got command RPT from MCS: ref #623995
2018-11-25 16:00:48 [DEBUG   ] summary = ERROR
2018-11-25 16:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623995  13 58447 57648425 A  ERRORERROR'
2018-11-25 16:00:48 [DEBUG   ] Got command RPT from MCS: ref #623996
2018-11-25 16:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   623996  77 58447 57648426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:00:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:01:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:01:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:01:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:01:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:01:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:01:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:01:09 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-25 16:01:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:01:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 16:01:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 16:02:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:02:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:02:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:02:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:02:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:02:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:02:09 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-25 16:02:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 16:02:20 [DEBUG   ] Got command RPT from MCS: ref #624014
2018-11-25 16:02:20 [DEBUG   ] summary = ERROR
2018-11-25 16:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624014  13 58447 57740533 A  ERRORERROR'
2018-11-25 16:02:20 [DEBUG   ] Got command RPT from MCS: ref #624015
2018-11-25 16:02:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624015  77 58447 57740725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:02:20 [DEBUG   ] Got command RPT from MCS: ref #624016
2018-11-25 16:02:20 [DEBUG   ] summary = ERROR
2018-11-25 16:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624016  13 58447 57740929 A  ERRORERROR'
2018-11-25 16:02:21 [DEBUG   ] Got command RPT from MCS: ref #624018
2018-11-25 16:02:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624018  77 58447 57741133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:02:21 [DEBUG   ] Got command RPT from MCS: ref #624020
2018-11-25 16:02:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624020  12 58447 57741337 A  ERRORB˜™š'
2018-11-25 16:02:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:02:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:03:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:03:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:03:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:03:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:03:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:03:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:03:09 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-25 16:03:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:03:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:03:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:04:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:04:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:04:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:04:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:04:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:04:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:04:09 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-11-25 16:04:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 16:04:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 16:04:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 16:05:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:05:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:05:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:05:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:05:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:05:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:05:09 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-11-25 16:05:17 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2018-11-25 16:05:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 16:05:48 [DEBUG   ] Got command RPT from MCS: ref #624028
2018-11-25 16:05:48 [DEBUG   ] summary = ERROR
2018-11-25 16:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624028  13 58447 57948425 A  ERRORERROR'
2018-11-25 16:05:48 [DEBUG   ] Got command RPT from MCS: ref #624029
2018-11-25 16:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624029  77 58447 57948426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:05:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 16:06:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 16:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:06:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:06:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:06:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:06:09 [WARNING ] (13, 1, 'bot')
2018-11-25 16:06:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:06:09 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-11-25 16:06:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 16:06:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 16:06:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 16:07:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:07:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 16:07:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:07:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:07:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:07:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:07:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:07:10 [DEBUG   ] Finished updating board flags in 2.242 seconds
2018-11-25 16:07:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 16:07:20 [DEBUG   ] Got command RPT from MCS: ref #624049
2018-11-25 16:07:20 [DEBUG   ] summary = ERROR
2018-11-25 16:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624049  13 58447 58040617 A  ERRORERROR'
2018-11-25 16:07:20 [DEBUG   ] Got command RPT from MCS: ref #624050
2018-11-25 16:07:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624050  77 58447 58040821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:07:21 [DEBUG   ] Got command RPT from MCS: ref #624051
2018-11-25 16:07:21 [DEBUG   ] summary = ERROR
2018-11-25 16:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624051  13 58447 58041025 A  ERRORERROR'
2018-11-25 16:07:21 [DEBUG   ] Got command RPT from MCS: ref #624052
2018-11-25 16:07:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624052  77 58447 58041217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:07:21 [DEBUG   ] Got command RPT from MCS: ref #624053
2018-11-25 16:07:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624053  12 58447 58041421 A  ERRORB™™š'
2018-11-25 16:07:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 16:07:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 16:08:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:08:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:08:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:08:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:08:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:08:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:08:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:08:10 [DEBUG   ] Finished updating board flags in 2.117 seconds
2018-11-25 16:08:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 16:08:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 16:08:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:09:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:09:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:09:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:09:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:09:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:09:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:09:10 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-11-25 16:09:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 16:09:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:09:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:10:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:10:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:10:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:10:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:10:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:10:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:10:10 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-11-25 16:10:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 16:10:38 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-25 16:10:48 [DEBUG   ] Got command RPT from MCS: ref #624058
2018-11-25 16:10:48 [DEBUG   ] summary = ERROR
2018-11-25 16:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624058  13 58447 58248433 A  ERRORERROR'
2018-11-25 16:10:48 [DEBUG   ] Got command RPT from MCS: ref #624059
2018-11-25 16:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624059  77 58447 58248434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:10:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:11:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:11:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:11:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:11:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:11:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:11:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:11:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:11:10 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-11-25 16:11:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:11:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:11:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:12:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:12:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:12:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:12:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:12:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:12:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:12:10 [DEBUG   ] Finished updating board flags in 1.834 seconds
2018-11-25 16:12:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:12:20 [DEBUG   ] Got command RPT from MCS: ref #624077
2018-11-25 16:12:20 [DEBUG   ] summary = ERROR
2018-11-25 16:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624077  13 58447 58340701 A  ERRORERROR'
2018-11-25 16:12:20 [DEBUG   ] Got command RPT from MCS: ref #624078
2018-11-25 16:12:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624078  77 58447 58340905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:12:21 [DEBUG   ] Got command RPT from MCS: ref #624079
2018-11-25 16:12:21 [DEBUG   ] summary = ERROR
2018-11-25 16:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624079  13 58447 58341109 A  ERRORERROR'
2018-11-25 16:12:21 [DEBUG   ] Got command RPT from MCS: ref #624081
2018-11-25 16:12:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624081  77 58447 58341301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:12:21 [DEBUG   ] Got command RPT from MCS: ref #624082
2018-11-25 16:12:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624082  12 58447 58341505 A  ERRORB˜™š'
2018-11-25 16:12:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:12:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-25 16:13:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:13:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:13:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:13:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:13:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:13:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:13:10 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-11-25 16:13:19 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-25 16:13:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 16:13:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 16:14:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:14:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:14:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:14:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:14:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:14:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:14:10 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-25 16:14:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:14:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:14:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:15:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:15:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:15:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:15:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:15:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:15:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:15:10 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-11-25 16:15:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 16:15:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-25 16:15:48 [DEBUG   ] Got command RPT from MCS: ref #624095
2018-11-25 16:15:48 [DEBUG   ] summary = ERROR
2018-11-25 16:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624095  13 58447 58548429 A  ERRORERROR'
2018-11-25 16:15:48 [DEBUG   ] Got command RPT from MCS: ref #624096
2018-11-25 16:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624096  77 58447 58548430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:15:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:16:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:16:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:16:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:16:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:16:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:16:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:16:10 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-25 16:16:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-25 16:16:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 16:16:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:17:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:17:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 16:17:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:17:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:17:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:17:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:17:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:17:10 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-11-25 16:17:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:17:20 [DEBUG   ] Got command RPT from MCS: ref #624112
2018-11-25 16:17:20 [DEBUG   ] summary = ERROR
2018-11-25 16:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624112  13 58447 58640793 A  ERRORERROR'
2018-11-25 16:17:20 [DEBUG   ] Got command RPT from MCS: ref #624113
2018-11-25 16:17:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:17:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624113  77 58447 58640985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:17:21 [DEBUG   ] Got command RPT from MCS: ref #624114
2018-11-25 16:17:21 [DEBUG   ] summary = ERROR
2018-11-25 16:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624114  13 58447 58641189 A  ERRORERROR'
2018-11-25 16:17:21 [DEBUG   ] Got command RPT from MCS: ref #624115
2018-11-25 16:17:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624115  77 58447 58641393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:17:21 [DEBUG   ] Got command RPT from MCS: ref #624116
2018-11-25 16:17:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624116  12 58447 58641585 A  ERRORB˜™š'
2018-11-25 16:17:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:17:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 16:18:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:18:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:18:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:18:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:18:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:18:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:18:11 [DEBUG   ] Finished updating board flags in 2.200 seconds
2018-11-25 16:18:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 16:18:40 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-25 16:18:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 16:19:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:19:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:19:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:19:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:19:10 [WARNING ] (13, 1, 'bot')
2018-11-25 16:19:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:19:10 [DEBUG   ] Finished updating board flags in 1.320 seconds
2018-11-25 16:19:20 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-25 16:19:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 16:20:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 16:20:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 16:20:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:20:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:20:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:20:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:20:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:20:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:20:11 [DEBUG   ] Finished updating board flags in 2.088 seconds
2018-11-25 16:20:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 16:20:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:20:48 [DEBUG   ] Got command RPT from MCS: ref #624121
2018-11-25 16:20:48 [DEBUG   ] summary = ERROR
2018-11-25 16:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624121  13 58447 58848425 A  ERRORERROR'
2018-11-25 16:20:48 [DEBUG   ] Got command RPT from MCS: ref #624122
2018-11-25 16:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624122  77 58447 58848426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:21:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 16:21:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:21:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:21:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:21:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:21:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:21:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:21:11 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-11-25 16:21:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-25 16:21:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 16:22:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:22:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:22:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:22:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:22:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:22:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:22:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:22:11 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-11-25 16:22:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:22:20 [DEBUG   ] Got command RPT from MCS: ref #624144
2018-11-25 16:22:20 [DEBUG   ] summary = ERROR
2018-11-25 16:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624144  13 58447 58940873 A  ERRORERROR'
2018-11-25 16:22:21 [DEBUG   ] Got command RPT from MCS: ref #624145
2018-11-25 16:22:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624145  77 58447 58941077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:22:21 [DEBUG   ] Got command RPT from MCS: ref #624146
2018-11-25 16:22:21 [DEBUG   ] summary = ERROR
2018-11-25 16:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624146  13 58447 58941269 A  ERRORERROR'
2018-11-25 16:22:21 [DEBUG   ] Got command RPT from MCS: ref #624148
2018-11-25 16:22:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624148  77 58447 58941473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:22:21 [DEBUG   ] Got command RPT from MCS: ref #624149
2018-11-25 16:22:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624149  12 58447 58941677 A  ERRORB™™š'
2018-11-25 16:22:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:23:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-25 16:23:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:23:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 16:23:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:23:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:23:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:23:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:23:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:23:11 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-11-25 16:23:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 16:23:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 16:24:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 16:24:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:24:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:24:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:24:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:24:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:24:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:24:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:24:11 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-25 16:24:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:24:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 16:25:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:25:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:25:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:25:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:25:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:25:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:25:11 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-11-25 16:25:21 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-25 16:25:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:25:48 [DEBUG   ] Got command RPT from MCS: ref #624158
2018-11-25 16:25:48 [DEBUG   ] summary = ERROR
2018-11-25 16:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624158  13 58447 59148429 A  ERRORERROR'
2018-11-25 16:25:48 [DEBUG   ] Got command RPT from MCS: ref #624159
2018-11-25 16:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624159  77 58447 59148430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:26:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-25 16:26:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:26:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:26:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:26:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:26:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:26:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:26:11 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-25 16:26:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 16:26:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 16:27:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:27:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:27:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:27:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:27:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:27:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:27:11 [WARNING ] (13, 1, 'bot')
2018-11-25 16:27:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:27:11 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-11-25 16:27:20 [DEBUG   ] Got command RPT from MCS: ref #624175
2018-11-25 16:27:20 [DEBUG   ] summary = ERROR
2018-11-25 16:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624175  13 58447 59240958 A  ERRORERROR'
2018-11-25 16:27:21 [DEBUG   ] Got command RPT from MCS: ref #624176
2018-11-25 16:27:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624176  77 58447 59241161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:27:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:27:21 [DEBUG   ] Got command RPT from MCS: ref #624177
2018-11-25 16:27:21 [DEBUG   ] summary = ERROR
2018-11-25 16:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624177  13 58447 59241365 A  ERRORERROR'
2018-11-25 16:27:21 [DEBUG   ] Got command RPT from MCS: ref #624178
2018-11-25 16:27:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624178  77 58447 59241558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:27:21 [DEBUG   ] Got command RPT from MCS: ref #624179
2018-11-25 16:27:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624179  12 58447 59241761 A  ERRORB˜™š'
2018-11-25 16:27:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:28:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:28:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:28:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:28:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:28:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:28:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:28:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:28:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:28:12 [DEBUG   ] Finished updating board flags in 2.204 seconds
2018-11-25 16:28:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:28:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:29:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-25 16:29:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:29:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:29:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:29:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:29:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:29:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:29:12 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-11-25 16:29:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 16:29:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 16:30:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 16:30:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:30:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 16:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:30:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:30:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 16:30:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:30:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:30:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:30:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:30:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:30:12 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-11-25 16:30:21 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 16:30:41 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-25 16:30:48 [DEBUG   ] Got command RPT from MCS: ref #624188
2018-11-25 16:30:48 [DEBUG   ] summary = ERROR
2018-11-25 16:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624188  13 58447 59448437 A  ERRORERROR'
2018-11-25 16:30:48 [DEBUG   ] Got command RPT from MCS: ref #624189
2018-11-25 16:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624189  77 58447 59448438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:31:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 16:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:31:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:31:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:31:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:31:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:31:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:31:12 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-25 16:31:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 16:31:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 16:32:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 16:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:32:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:32:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:32:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:32:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:32:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:32:12 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-11-25 16:32:21 [DEBUG   ] Got command RPT from MCS: ref #624207
2018-11-25 16:32:21 [DEBUG   ] summary = ERROR
2018-11-25 16:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624207  13 58447 59541033 A  ERRORERROR'
2018-11-25 16:32:21 [DEBUG   ] Got command RPT from MCS: ref #624208
2018-11-25 16:32:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624208  77 58447 59541237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:32:21 [DEBUG   ] Got command RPT from MCS: ref #624209
2018-11-25 16:32:21 [DEBUG   ] summary = ERROR
2018-11-25 16:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624209  13 58447 59541441 A  ERRORERROR'
2018-11-25 16:32:21 [DEBUG   ] Got command RPT from MCS: ref #624211
2018-11-25 16:32:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624211  77 58447 59541645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:32:21 [DEBUG   ] Got command RPT from MCS: ref #624212
2018-11-25 16:32:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624212  12 58447 59541837 A  ERRORB™™š'
2018-11-25 16:32:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 16:32:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:33:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 16:33:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 16:33:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:33:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:33:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:33:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:33:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:33:12 [DEBUG   ] Finished updating board flags in 1.857 seconds
2018-11-25 16:33:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:33:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:34:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:34:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:34:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:34:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:34:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:34:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:34:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:34:12 [DEBUG   ] Finished updating board flags in 1.741 seconds
2018-11-25 16:34:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:34:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 16:35:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:35:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:35:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:35:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:35:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:35:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:35:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:35:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:35:12 [DEBUG   ] Finished updating board flags in 1.680 seconds
2018-11-25 16:35:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 16:35:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 16:35:48 [DEBUG   ] Got command RPT from MCS: ref #624221
2018-11-25 16:35:48 [DEBUG   ] summary = ERROR
2018-11-25 16:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624221  13 58447 59748437 A  ERRORERROR'
2018-11-25 16:35:48 [DEBUG   ] Got command RPT from MCS: ref #624222
2018-11-25 16:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624222  77 58447 59748438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:36:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:36:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:36:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:36:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:36:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:36:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:36:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:36:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:36:12 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-11-25 16:36:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:36:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:37:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:37:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:37:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:37:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:37:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:37:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:37:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:37:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:37:12 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-25 16:37:21 [DEBUG   ] Got command RPT from MCS: ref #624242
2018-11-25 16:37:21 [DEBUG   ] summary = ERROR
2018-11-25 16:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624242  13 58447 59841125 A  ERRORERROR'
2018-11-25 16:37:21 [DEBUG   ] Got command RPT from MCS: ref #624243
2018-11-25 16:37:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624243  77 58447 59841317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:37:21 [DEBUG   ] Got command RPT from MCS: ref #624244
2018-11-25 16:37:21 [DEBUG   ] summary = ERROR
2018-11-25 16:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624244  13 58447 59841521 A  ERRORERROR'
2018-11-25 16:37:21 [DEBUG   ] Got command RPT from MCS: ref #624245
2018-11-25 16:37:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624245  77 58447 59841726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:37:21 [DEBUG   ] Got command RPT from MCS: ref #624246
2018-11-25 16:37:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:37:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624246  12 58447 59841929 A  ERRORB™™š'
2018-11-25 16:37:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:37:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:38:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:38:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:38:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:38:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:38:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:38:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:38:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:38:12 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-11-25 16:38:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-25 16:38:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:39:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:39:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:39:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:39:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:39:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:39:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:39:12 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-11-25 16:39:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:39:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 16:40:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 16:40:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:40:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:40:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:40:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:40:12 [WARNING ] (13, 1, 'bot')
2018-11-25 16:40:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:40:12 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-11-25 16:40:22 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 16:40:42 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-11-25 16:40:48 [DEBUG   ] Got command RPT from MCS: ref #624251
2018-11-25 16:40:48 [DEBUG   ] summary = ERROR
2018-11-25 16:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624251  13 58447 60048433 A  ERRORERROR'
2018-11-25 16:40:48 [DEBUG   ] Got command RPT from MCS: ref #624252
2018-11-25 16:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624252  77 58447 60048434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:41:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 16:41:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:41:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:41:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:41:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:41:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:41:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:41:13 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-11-25 16:41:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:41:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 16:42:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:42:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:42:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:42:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:42:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:42:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:42:13 [DEBUG   ] Finished updating board flags in 2.150 seconds
2018-11-25 16:42:21 [DEBUG   ] Got command RPT from MCS: ref #624270
2018-11-25 16:42:21 [DEBUG   ] summary = ERROR
2018-11-25 16:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624270  13 58447 60141209 A  ERRORERROR'
2018-11-25 16:42:21 [DEBUG   ] Got command RPT from MCS: ref #624271
2018-11-25 16:42:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624271  77 58447 60141413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:42:21 [DEBUG   ] Got command RPT from MCS: ref #624272
2018-11-25 16:42:21 [DEBUG   ] summary = ERROR
2018-11-25 16:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624272  13 58447 60141605 A  ERRORERROR'
2018-11-25 16:42:21 [DEBUG   ] Got command RPT from MCS: ref #624274
2018-11-25 16:42:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624274  77 58447 60141809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:42:22 [DEBUG   ] Got command RPT from MCS: ref #624275
2018-11-25 16:42:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624275  12 58447 60142013 A  ERRORB—™š'
2018-11-25 16:42:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:42:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:43:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 16:43:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:43:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:43:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:43:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:43:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:43:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:43:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:43:13 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-11-25 16:43:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:43:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:44:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:44:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:44:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:44:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:44:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:44:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:44:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:44:13 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-11-25 16:44:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 16:44:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 16:45:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 16:45:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:45:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:45:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:45:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:45:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:45:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:45:13 [DEBUG   ] Finished updating board flags in 1.952 seconds
2018-11-25 16:45:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 16:45:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 16:45:48 [DEBUG   ] Got command RPT from MCS: ref #624288
2018-11-25 16:45:48 [DEBUG   ] summary = ERROR
2018-11-25 16:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624288  13 58447 60348437 A  ERRORERROR'
2018-11-25 16:45:48 [DEBUG   ] Got command RPT from MCS: ref #624289
2018-11-25 16:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624289  77 58447 60348438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:46:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 16:46:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:46:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:46:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:46:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:46:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:46:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:46:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:46:13 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-25 16:46:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 16:46:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 16:47:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:47:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:47:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:47:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:47:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:47:13 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-11-25 16:47:21 [DEBUG   ] Got command RPT from MCS: ref #624305
2018-11-25 16:47:21 [DEBUG   ] summary = ERROR
2018-11-25 16:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624305  13 58447 60441297 A  ERRORERROR'
2018-11-25 16:47:21 [DEBUG   ] Got command RPT from MCS: ref #624306
2018-11-25 16:47:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624306  77 58447 60441501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:47:21 [DEBUG   ] Got command RPT from MCS: ref #624307
2018-11-25 16:47:21 [DEBUG   ] summary = ERROR
2018-11-25 16:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624307  13 58447 60441693 A  ERRORERROR'
2018-11-25 16:47:21 [DEBUG   ] Got command RPT from MCS: ref #624308
2018-11-25 16:47:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624308  77 58447 60441897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:47:22 [DEBUG   ] Got command RPT from MCS: ref #624309
2018-11-25 16:47:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624309  12 58447 60442101 A  ERRORB˜™š'
2018-11-25 16:47:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:47:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:48:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 16:48:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:48:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:48:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:48:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:48:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:48:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:48:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:48:13 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-25 16:48:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:48:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:49:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:49:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:49:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:49:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:49:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:49:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:49:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:49:13 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-11-25 16:49:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 16:49:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 16:50:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 16:50:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:50:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:50:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:50:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:50:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:50:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:50:13 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-25 16:50:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 16:50:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:50:48 [DEBUG   ] Got command RPT from MCS: ref #624314
2018-11-25 16:50:48 [DEBUG   ] summary = ERROR
2018-11-25 16:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624314  13 58447 60648437 A  ERRORERROR'
2018-11-25 16:50:48 [DEBUG   ] Got command RPT from MCS: ref #624315
2018-11-25 16:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624315  77 58447 60648438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:51:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:51:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:51:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:51:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:51:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:51:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:51:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:51:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:51:13 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-25 16:51:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:51:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 16:52:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:52:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:52:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:52:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 16:52:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:52:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:52:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:52:13 [WARNING ] (13, 1, 'bot')
2018-11-25 16:52:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:52:13 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-11-25 16:52:21 [DEBUG   ] Got command RPT from MCS: ref #624337
2018-11-25 16:52:21 [DEBUG   ] summary = ERROR
2018-11-25 16:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624337  13 58447 60741377 A  ERRORERROR'
2018-11-25 16:52:21 [DEBUG   ] Got command RPT from MCS: ref #624338
2018-11-25 16:52:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624338  77 58447 60741581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:52:21 [DEBUG   ] Got command RPT from MCS: ref #624339
2018-11-25 16:52:21 [DEBUG   ] summary = ERROR
2018-11-25 16:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624339  13 58447 60741785 A  ERRORERROR'
2018-11-25 16:52:21 [DEBUG   ] Got command RPT from MCS: ref #624341
2018-11-25 16:52:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:52:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624341  77 58447 60741977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:52:22 [DEBUG   ] Got command RPT from MCS: ref #624342
2018-11-25 16:52:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624342  12 58447 60742181 A  ERRORB™™š'
2018-11-25 16:52:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 16:52:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:53:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 16:53:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:53:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:53:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:53:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:53:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:53:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:53:14 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-11-25 16:53:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:53:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:54:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:54:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:54:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:54:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:54:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:54:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:54:14 [DEBUG   ] Finished updating board flags in 1.942 seconds
2018-11-25 16:54:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 16:54:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 16:55:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 16:55:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:55:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 16:55:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:55:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:55:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:55:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:55:14 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-25 16:55:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 16:55:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 16:55:48 [DEBUG   ] Got command RPT from MCS: ref #624351
2018-11-25 16:55:48 [DEBUG   ] summary = ERROR
2018-11-25 16:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624351  13 58447 60948437 A  ERRORERROR'
2018-11-25 16:55:48 [DEBUG   ] Got command RPT from MCS: ref #624352
2018-11-25 16:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624352  77 58447 60948438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:56:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 16:56:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:56:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:56:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:56:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:56:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:56:14 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-11-25 16:56:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-25 16:56:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 16:57:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 16:57:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:57:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:57:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:57:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:57:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:57:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:57:14 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-25 16:57:21 [DEBUG   ] Got command RPT from MCS: ref #624368
2018-11-25 16:57:21 [DEBUG   ] summary = ERROR
2018-11-25 16:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624368  13 58447 61041469 A  ERRORERROR'
2018-11-25 16:57:21 [DEBUG   ] Got command RPT from MCS: ref #624369
2018-11-25 16:57:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624369  77 58447 61041673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:57:21 [DEBUG   ] Got command RPT from MCS: ref #624370
2018-11-25 16:57:21 [DEBUG   ] summary = ERROR
2018-11-25 16:57:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624370  13 58447 61041865 A  ERRORERROR'
2018-11-25 16:57:22 [DEBUG   ] Got command RPT from MCS: ref #624371
2018-11-25 16:57:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 16:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624371  77 58447 61042069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 16:57:22 [DEBUG   ] Got command RPT from MCS: ref #624372
2018-11-25 16:57:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 16:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624372  12 58447 61042273 A  ERRORB˜™š'
2018-11-25 16:57:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:57:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 16:58:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 16:58:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:58:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:58:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:58:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:58:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:58:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:58:14 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-25 16:58:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 16:58:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 16:59:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 16:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 16:59:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 16:59:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 16:59:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:59:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:59:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:59:14 [WARNING ] (13, 1, 'bot')
2018-11-25 16:59:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 16:59:14 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-25 16:59:26 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-25 16:59:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 17:00:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 17:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:00:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:00:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:00:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:00:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:00:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:00:14 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-25 17:00:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 17:00:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 17:00:48 [DEBUG   ] Got command RPT from MCS: ref #624381
2018-11-25 17:00:48 [DEBUG   ] summary = ERROR
2018-11-25 17:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624381  13 58447 61248433 A  ERRORERROR'
2018-11-25 17:00:48 [DEBUG   ] Got command RPT from MCS: ref #624382
2018-11-25 17:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624382  77 58447 61248434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:01:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 17:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 17:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:01:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:01:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:01:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:01:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:01:14 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-11-25 17:01:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 17:01:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 17:02:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:02:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:02:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:02:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:02:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:02:14 [WARNING ] (13, 1, 'bot')
2018-11-25 17:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:02:14 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-11-25 17:02:21 [DEBUG   ] Got command RPT from MCS: ref #624400
2018-11-25 17:02:21 [DEBUG   ] summary = ERROR
2018-11-25 17:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624400  13 58447 61341557 A  ERRORERROR'
2018-11-25 17:02:21 [DEBUG   ] Got command RPT from MCS: ref #624401
2018-11-25 17:02:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624401  77 58447 61341749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:02:21 [DEBUG   ] Got command RPT from MCS: ref #624402
2018-11-25 17:02:21 [DEBUG   ] summary = ERROR
2018-11-25 17:02:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624402  13 58447 61341953 A  ERRORERROR'
2018-11-25 17:02:22 [DEBUG   ] Got command RPT from MCS: ref #624404
2018-11-25 17:02:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624404  77 58447 61342157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:02:22 [DEBUG   ] Got command RPT from MCS: ref #624405
2018-11-25 17:02:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624405  12 58447 61342361 A  ERRORB˜™š'
2018-11-25 17:02:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-25 17:02:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 17:03:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:03:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 17:03:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:03:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:03:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:03:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:03:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:03:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:03:15 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-11-25 17:03:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:03:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 17:04:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 17:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:04:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:04:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:04:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:04:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:04:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:04:15 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-11-25 17:04:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 17:04:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 17:05:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 17:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:05:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:05:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:05:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:05:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:05:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:05:15 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-25 17:05:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:05:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 17:05:48 [DEBUG   ] Got command RPT from MCS: ref #624414
2018-11-25 17:05:48 [DEBUG   ] summary = ERROR
2018-11-25 17:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624414  13 58447 61548445 A  ERRORERROR'
2018-11-25 17:05:48 [DEBUG   ] Got command RPT from MCS: ref #624415
2018-11-25 17:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624415  77 58447 61548446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:06:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 17:06:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:06:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:06:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:06:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:06:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:06:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:06:15 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-25 17:06:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 17:06:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:07:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 17:07:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:07:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:07:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:07:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:07:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:07:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:07:15 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-25 17:07:21 [DEBUG   ] Got command RPT from MCS: ref #624435
2018-11-25 17:07:21 [DEBUG   ] summary = ERROR
2018-11-25 17:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624435  13 58447 61641637 A  ERRORERROR'
2018-11-25 17:07:21 [DEBUG   ] Got command RPT from MCS: ref #624436
2018-11-25 17:07:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624436  77 58447 61641841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:07:22 [DEBUG   ] Got command RPT from MCS: ref #624437
2018-11-25 17:07:22 [DEBUG   ] summary = ERROR
2018-11-25 17:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624437  13 58447 61642045 A  ERRORERROR'
2018-11-25 17:07:22 [DEBUG   ] Got command RPT from MCS: ref #624438
2018-11-25 17:07:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624438  77 58447 61642237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:07:22 [DEBUG   ] Got command RPT from MCS: ref #624439
2018-11-25 17:07:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624439  12 58447 61642441 A  ERRORB˜™š'
2018-11-25 17:07:28 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-25 17:07:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 17:08:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:08:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:08:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:08:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:08:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:08:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:08:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:08:15 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-11-25 17:08:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 17:08:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 17:09:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 17:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:09:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:09:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:09:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:09:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:09:15 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-11-25 17:09:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-25 17:09:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 17:10:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 17:10:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:10:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:10:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:10:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:10:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:10:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:10:15 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-25 17:10:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 17:10:48 [DEBUG   ] Got command RPT from MCS: ref #624444
2018-11-25 17:10:48 [DEBUG   ] summary = ERROR
2018-11-25 17:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624444  13 58447 61848437 A  ERRORERROR'
2018-11-25 17:10:48 [DEBUG   ] Got command RPT from MCS: ref #624445
2018-11-25 17:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624445  77 58447 61848438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:10:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 17:11:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 17:11:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:11:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:11:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:11:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:11:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:11:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:11:15 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-11-25 17:11:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 17:11:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:12:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:12:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:12:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 17:12:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:12:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:12:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:12:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:12:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:12:15 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-11-25 17:12:21 [DEBUG   ] Got command RPT from MCS: ref #624463
2018-11-25 17:12:21 [DEBUG   ] summary = ERROR
2018-11-25 17:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624463  13 58447 61941721 A  ERRORERROR'
2018-11-25 17:12:21 [DEBUG   ] Got command RPT from MCS: ref #624464
2018-11-25 17:12:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:12:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624464  77 58447 61941925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:12:22 [DEBUG   ] Got command RPT from MCS: ref #624465
2018-11-25 17:12:22 [DEBUG   ] summary = ERROR
2018-11-25 17:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624465  13 58447 61942129 A  ERRORERROR'
2018-11-25 17:12:22 [DEBUG   ] Got command RPT from MCS: ref #624467
2018-11-25 17:12:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624467  77 58447 61942321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:12:22 [DEBUG   ] Got command RPT from MCS: ref #624469
2018-11-25 17:12:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624469  12 58447 61942525 A  ERRORB˜™š'
2018-11-25 17:12:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 17:12:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 17:13:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 17:13:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:13:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:13:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:13:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:13:15 [WARNING ] (13, 1, 'bot')
2018-11-25 17:13:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:13:15 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-11-25 17:13:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 17:13:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 17:14:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 17:14:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:14:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:14:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:14:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:14:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:14:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:14:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:14:16 [DEBUG   ] Finished updating board flags in 2.250 seconds
2018-11-25 17:14:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 17:14:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 17:15:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 17:15:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:15:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:15:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:15:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:15:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:15:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:15:16 [DEBUG   ] Finished updating board flags in 2.149 seconds
2018-11-25 17:15:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 17:15:48 [DEBUG   ] Got command RPT from MCS: ref #624481
2018-11-25 17:15:48 [DEBUG   ] summary = ERROR
2018-11-25 17:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624481  13 58447 62148437 A  ERRORERROR'
2018-11-25 17:15:48 [DEBUG   ] Got command RPT from MCS: ref #624482
2018-11-25 17:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624482  77 58447 62148438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:15:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 17:16:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 17:16:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:16:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:16:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:16:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:16:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:16:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:16:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:16:16 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-25 17:16:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 17:16:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:17:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 17:17:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 17:17:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:17:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:17:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:17:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:17:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:17:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:17:16 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-11-25 17:17:21 [DEBUG   ] Got command RPT from MCS: ref #624498
2018-11-25 17:17:21 [DEBUG   ] summary = ERROR
2018-11-25 17:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624498  13 58447 62241813 A  ERRORERROR'
2018-11-25 17:17:22 [DEBUG   ] Got command RPT from MCS: ref #624499
2018-11-25 17:17:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624499  77 58447 62242005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:17:22 [DEBUG   ] Got command RPT from MCS: ref #624500
2018-11-25 17:17:22 [DEBUG   ] summary = ERROR
2018-11-25 17:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624500  13 58447 62242209 A  ERRORERROR'
2018-11-25 17:17:22 [DEBUG   ] Got command RPT from MCS: ref #624501
2018-11-25 17:17:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624501  77 58447 62242413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:17:22 [DEBUG   ] Got command RPT from MCS: ref #624502
2018-11-25 17:17:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624502  12 58447 62242617 A  ERRORB˜™š'
2018-11-25 17:17:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-25 17:17:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 17:18:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 17:18:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:18:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 17:18:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:18:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:18:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:18:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:18:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:18:16 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-25 17:18:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-25 17:18:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 17:19:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 17:19:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:19:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 17:19:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:19:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:19:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:19:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:19:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:19:16 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-11-25 17:19:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 17:19:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 17:20:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:20:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:20:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:20:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:20:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:20:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:20:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:20:16 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-11-25 17:20:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 17:20:48 [DEBUG   ] Got command RPT from MCS: ref #624507
2018-11-25 17:20:48 [DEBUG   ] summary = ERROR
2018-11-25 17:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624507  13 58447 62448445 A  ERRORERROR'
2018-11-25 17:20:48 [DEBUG   ] Got command RPT from MCS: ref #624508
2018-11-25 17:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624508  77 58447 62448446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:20:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 17:21:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 17:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:21:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:21:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:21:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:21:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:21:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:21:16 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-11-25 17:21:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:21:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:22:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 17:22:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:22:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:22:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:22:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:22:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:22:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:22:16 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-25 17:22:21 [DEBUG   ] Got command RPT from MCS: ref #624530
2018-11-25 17:22:21 [DEBUG   ] summary = ERROR
2018-11-25 17:22:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624530  13 58447 62541893 A  ERRORERROR'
2018-11-25 17:22:22 [DEBUG   ] Got command RPT from MCS: ref #624531
2018-11-25 17:22:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624531  77 58447 62542097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:22:22 [DEBUG   ] Got command RPT from MCS: ref #624532
2018-11-25 17:22:22 [DEBUG   ] summary = ERROR
2018-11-25 17:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624532  13 58447 62542301 A  ERRORERROR'
2018-11-25 17:22:22 [DEBUG   ] Got command RPT from MCS: ref #624534
2018-11-25 17:22:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624534  77 58447 62542493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:22:22 [DEBUG   ] Got command RPT from MCS: ref #624535
2018-11-25 17:22:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624535  12 58447 62542697 A  ERRORB™™š'
2018-11-25 17:22:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 17:22:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:23:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 17:23:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:23:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:23:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:23:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:23:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:23:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:23:16 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-25 17:23:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 17:23:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 17:24:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 17:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:24:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:24:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:24:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:24:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:24:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:24:16 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-25 17:24:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 17:24:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 17:25:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 17:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:25:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:25:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:25:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:25:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:25:16 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-25 17:25:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 17:25:48 [DEBUG   ] Got command RPT from MCS: ref #624544
2018-11-25 17:25:48 [DEBUG   ] summary = ERROR
2018-11-25 17:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624544  13 58447 62748445 A  ERRORERROR'
2018-11-25 17:25:48 [DEBUG   ] Got command RPT from MCS: ref #624545
2018-11-25 17:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624545  77 58447 62748446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:25:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 17:26:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 17:26:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:26:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:26:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:26:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:26:16 [WARNING ] (13, 1, 'bot')
2018-11-25 17:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:26:16 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-11-25 17:26:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 17:26:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:27:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 17:27:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:27:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:27:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:27:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:27:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:27:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:27:17 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-11-25 17:27:21 [DEBUG   ] Got command RPT from MCS: ref #624561
2018-11-25 17:27:21 [DEBUG   ] summary = ERROR
2018-11-25 17:27:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624561  13 58447 62841981 A  ERRORERROR'
2018-11-25 17:27:22 [DEBUG   ] Got command RPT from MCS: ref #624562
2018-11-25 17:27:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624562  77 58447 62842185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:27:22 [DEBUG   ] Got command RPT from MCS: ref #624563
2018-11-25 17:27:22 [DEBUG   ] summary = ERROR
2018-11-25 17:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624563  13 58447 62842377 A  ERRORERROR'
2018-11-25 17:27:22 [DEBUG   ] Got command RPT from MCS: ref #624564
2018-11-25 17:27:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624564  77 58447 62842581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:27:22 [DEBUG   ] Got command RPT from MCS: ref #624565
2018-11-25 17:27:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:27:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624565  12 58447 62842785 A  ERRORB˜™š'
2018-11-25 17:27:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 17:27:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:28:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:28:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:28:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:28:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:28:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:28:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:28:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:28:17 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-11-25 17:28:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-25 17:28:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 17:29:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:29:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:29:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:29:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:29:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:29:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:29:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:29:17 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-25 17:29:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 17:29:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 17:30:12 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-25 17:30:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:30:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:30:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:30:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:30:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:30:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:30:17 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-11-25 17:30:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 17:30:48 [DEBUG   ] Got command RPT from MCS: ref #624574
2018-11-25 17:30:48 [DEBUG   ] summary = ERROR
2018-11-25 17:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624574  13 58447 63048445 A  ERRORERROR'
2018-11-25 17:30:48 [DEBUG   ] Got command RPT from MCS: ref #624575
2018-11-25 17:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624575  77 58447 63048446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:30:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 17:31:13 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-25 17:31:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:31:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:31:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:31:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:31:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:31:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:31:17 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-11-25 17:31:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 17:31:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 17:32:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 17:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:32:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:32:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 17:32:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:32:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:32:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:32:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:32:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:32:17 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-11-25 17:32:22 [DEBUG   ] Got command RPT from MCS: ref #624593
2018-11-25 17:32:22 [DEBUG   ] summary = ERROR
2018-11-25 17:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624593  13 58447 63142061 A  ERRORERROR'
2018-11-25 17:32:22 [DEBUG   ] Got command RPT from MCS: ref #624594
2018-11-25 17:32:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624594  77 58447 63142265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:32:22 [DEBUG   ] Got command RPT from MCS: ref #624595
2018-11-25 17:32:22 [DEBUG   ] summary = ERROR
2018-11-25 17:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624595  13 58447 63142469 A  ERRORERROR'
2018-11-25 17:32:22 [DEBUG   ] Got command RPT from MCS: ref #624597
2018-11-25 17:32:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624597  77 58447 63142661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:32:22 [DEBUG   ] Got command RPT from MCS: ref #624599
2018-11-25 17:32:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624599  12 58447 63142865 A  ERRORB˜™š'
2018-11-25 17:32:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 17:32:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:33:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 17:33:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:33:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 17:33:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:33:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:33:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:33:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:33:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:33:17 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-25 17:33:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 17:33:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 17:34:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 17:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:34:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:34:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:34:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:34:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:34:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:34:17 [DEBUG   ] Finished updating board flags in 1.680 seconds
2018-11-25 17:34:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 17:34:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 17:35:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 17:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:35:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:35:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:35:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:35:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:35:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:35:17 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-11-25 17:35:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:35:48 [DEBUG   ] Got command RPT from MCS: ref #624607
2018-11-25 17:35:48 [DEBUG   ] summary = ERROR
2018-11-25 17:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624607  13 58447 63348441 A  ERRORERROR'
2018-11-25 17:35:48 [DEBUG   ] Got command RPT from MCS: ref #624608
2018-11-25 17:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624608  77 58447 63348442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:35:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:36:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 17:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:36:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 17:36:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:36:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:36:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:36:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:36:17 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-11-25 17:36:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 17:36:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:37:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 17:37:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:37:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 17:37:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:37:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:37:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:37:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:37:17 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-11-25 17:37:22 [DEBUG   ] Got command RPT from MCS: ref #624628
2018-11-25 17:37:22 [DEBUG   ] summary = ERROR
2018-11-25 17:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624628  13 58447 63442149 A  ERRORERROR'
2018-11-25 17:37:22 [DEBUG   ] Got command RPT from MCS: ref #624629
2018-11-25 17:37:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624629  77 58447 63442353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:37:22 [DEBUG   ] Got command RPT from MCS: ref #624630
2018-11-25 17:37:22 [DEBUG   ] summary = ERROR
2018-11-25 17:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624630  13 58447 63442557 A  ERRORERROR'
2018-11-25 17:37:22 [DEBUG   ] Got command RPT from MCS: ref #624631
2018-11-25 17:37:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624631  77 58447 63442749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:37:22 [DEBUG   ] Got command RPT from MCS: ref #624632
2018-11-25 17:37:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624632  12 58447 63442953 A  ERRORB™™š'
2018-11-25 17:37:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 17:37:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 17:38:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 17:38:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:38:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:38:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:38:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:38:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:38:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:38:17 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-11-25 17:38:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 17:38:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 17:39:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 17:39:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:39:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:39:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:39:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:39:17 [WARNING ] (13, 1, 'bot')
2018-11-25 17:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:39:17 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-11-25 17:39:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 17:39:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 17:40:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 17:40:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:40:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:40:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:40:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:40:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:40:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:40:18 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-11-25 17:40:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 17:40:48 [DEBUG   ] Got command RPT from MCS: ref #624637
2018-11-25 17:40:48 [DEBUG   ] summary = ERROR
2018-11-25 17:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624637  13 58447 63648449 A  ERRORERROR'
2018-11-25 17:40:48 [DEBUG   ] Got command RPT from MCS: ref #624638
2018-11-25 17:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624638  77 58447 63648450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:40:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 17:41:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 17:41:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:41:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:41:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:41:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:41:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:41:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:41:18 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-25 17:41:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 17:41:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-25 17:42:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 17:42:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:42:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 17:42:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:42:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:42:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:42:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:42:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:42:18 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-11-25 17:42:22 [DEBUG   ] Got command RPT from MCS: ref #624656
2018-11-25 17:42:22 [DEBUG   ] summary = ERROR
2018-11-25 17:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624656  13 58447 63742229 A  ERRORERROR'
2018-11-25 17:42:22 [DEBUG   ] Got command RPT from MCS: ref #624657
2018-11-25 17:42:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624657  77 58447 63742433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:42:22 [DEBUG   ] Got command RPT from MCS: ref #624658
2018-11-25 17:42:22 [DEBUG   ] summary = ERROR
2018-11-25 17:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624658  13 58447 63742637 A  ERRORERROR'
2018-11-25 17:42:22 [DEBUG   ] Got command RPT from MCS: ref #624660
2018-11-25 17:42:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624660  77 58447 63742841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:42:23 [DEBUG   ] Got command RPT from MCS: ref #624662
2018-11-25 17:42:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624662  12 58447 63743033 A  ERRORB˜™š'
2018-11-25 17:42:35 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-25 17:42:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 17:43:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 17:43:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:43:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:43:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:43:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:43:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:43:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:43:18 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-25 17:43:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 17:43:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:44:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 17:44:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:44:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:44:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:44:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:44:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:44:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:44:18 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-25 17:44:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 17:44:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 17:45:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:45:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:45:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:45:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:45:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:45:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:45:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:45:18 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-25 17:45:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:45:48 [DEBUG   ] Got command RPT from MCS: ref #624674
2018-11-25 17:45:48 [DEBUG   ] summary = ERROR
2018-11-25 17:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624674  13 58447 63948445 A  ERRORERROR'
2018-11-25 17:45:48 [DEBUG   ] Got command RPT from MCS: ref #624675
2018-11-25 17:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624675  77 58447 63948446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:45:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 17:46:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 17:46:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:46:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 17:46:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:46:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:46:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:46:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:46:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:46:18 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-11-25 17:46:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 17:46:56 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 17:47:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 17:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:47:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:47:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:47:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:47:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:47:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:47:18 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-25 17:47:22 [DEBUG   ] Got command RPT from MCS: ref #624691
2018-11-25 17:47:22 [DEBUG   ] summary = ERROR
2018-11-25 17:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624691  13 58447 64042317 A  ERRORERROR'
2018-11-25 17:47:22 [DEBUG   ] Got command RPT from MCS: ref #624692
2018-11-25 17:47:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624692  77 58447 64042521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:47:22 [DEBUG   ] Got command RPT from MCS: ref #624693
2018-11-25 17:47:22 [DEBUG   ] summary = ERROR
2018-11-25 17:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624693  13 58447 64042725 A  ERRORERROR'
2018-11-25 17:47:22 [DEBUG   ] Got command RPT from MCS: ref #624694
2018-11-25 17:47:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:47:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624694  77 58447 64042917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:47:23 [DEBUG   ] Got command RPT from MCS: ref #624695
2018-11-25 17:47:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624695  12 58447 64043121 A  ERRORB™™š'
2018-11-25 17:47:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 17:47:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 17:48:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 17:48:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:48:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 17:48:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:48:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:48:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:48:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:48:18 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-11-25 17:48:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 17:48:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:49:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 17:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:49:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:49:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:49:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:49:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:49:18 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-11-25 17:49:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 17:49:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 17:50:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 17:50:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:50:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:50:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:50:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:50:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:50:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:50:18 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-25 17:50:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 17:50:48 [DEBUG   ] Got command RPT from MCS: ref #624700
2018-11-25 17:50:48 [DEBUG   ] summary = ERROR
2018-11-25 17:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624700  13 58447 64248449 A  ERRORERROR'
2018-11-25 17:50:48 [DEBUG   ] Got command RPT from MCS: ref #624701
2018-11-25 17:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624701  77 58447 64248450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:50:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 17:51:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 17:51:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:51:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:51:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:51:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:51:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:51:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:51:18 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-11-25 17:51:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:51:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 17:52:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 17:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:52:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:52:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 17:52:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:52:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:52:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:52:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:52:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:52:18 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-11-25 17:52:22 [DEBUG   ] Got command RPT from MCS: ref #624723
2018-11-25 17:52:22 [DEBUG   ] summary = ERROR
2018-11-25 17:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624723  13 58447 64342405 A  ERRORERROR'
2018-11-25 17:52:22 [DEBUG   ] Got command RPT from MCS: ref #624724
2018-11-25 17:52:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624724  77 58447 64342609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:52:22 [DEBUG   ] Got command RPT from MCS: ref #624725
2018-11-25 17:52:22 [DEBUG   ] summary = ERROR
2018-11-25 17:52:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624725  13 58447 64342801 A  ERRORERROR'
2018-11-25 17:52:23 [DEBUG   ] Got command RPT from MCS: ref #624727
2018-11-25 17:52:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624727  77 58447 64343005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:52:23 [DEBUG   ] Got command RPT from MCS: ref #624728
2018-11-25 17:52:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624728  12 58447 64343209 A  ERRORB™™š'
2018-11-25 17:52:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 17:52:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 17:53:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 17:53:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:53:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:53:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:53:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:53:18 [WARNING ] (13, 1, 'bot')
2018-11-25 17:53:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:53:18 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-25 17:53:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-25 17:53:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 17:54:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 17:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:54:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:54:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:54:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:54:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:54:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:54:19 [DEBUG   ] Finished updating board flags in 2.252 seconds
2018-11-25 17:54:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 17:54:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 17:55:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 17:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:55:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 17:55:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:55:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:55:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:55:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:55:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:55:19 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-11-25 17:55:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 17:55:48 [DEBUG   ] Got command RPT from MCS: ref #624737
2018-11-25 17:55:48 [DEBUG   ] summary = ERROR
2018-11-25 17:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624737  13 58447 64548453 A  ERRORERROR'
2018-11-25 17:55:48 [DEBUG   ] Got command RPT from MCS: ref #624738
2018-11-25 17:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624738  77 58447 64548454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:55:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 17:56:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 17:56:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:56:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:56:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:56:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:56:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:56:19 [DEBUG   ] Finished updating board flags in 1.964 seconds
2018-11-25 17:56:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:56:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 17:57:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 17:57:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:57:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:57:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:57:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:57:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:57:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:57:19 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-25 17:57:22 [DEBUG   ] Got command RPT from MCS: ref #624754
2018-11-25 17:57:22 [DEBUG   ] summary = ERROR
2018-11-25 17:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624754  13 58447 64642493 A  ERRORERROR'
2018-11-25 17:57:22 [DEBUG   ] Got command RPT from MCS: ref #624755
2018-11-25 17:57:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624755  77 58447 64642697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:57:22 [DEBUG   ] Got command RPT from MCS: ref #624756
2018-11-25 17:57:22 [DEBUG   ] summary = ERROR
2018-11-25 17:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624756  13 58447 64642889 A  ERRORERROR'
2018-11-25 17:57:23 [DEBUG   ] Got command RPT from MCS: ref #624757
2018-11-25 17:57:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 17:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624757  77 58447 64643093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 17:57:23 [DEBUG   ] Got command RPT from MCS: ref #624758
2018-11-25 17:57:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 17:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624758  12 58447 64643297 A  ERRORB˜™š'
2018-11-25 17:57:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 17:57:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:58:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 17:58:18 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:58:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:58:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:58:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:58:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:58:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:58:19 [DEBUG   ] Finished updating board flags in 1.756 seconds
2018-11-25 17:58:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 17:58:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 17:59:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 17:59:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 17:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 17:59:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:59:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:59:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:59:19 [WARNING ] (13, 1, 'bot')
2018-11-25 17:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 17:59:19 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-25 17:59:38 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-25 17:59:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 18:00:18 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2018-11-25 18:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:00:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 18:00:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:00:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:00:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:00:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:00:19 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-11-25 18:00:38 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-11-25 18:00:48 [DEBUG   ] Got command RPT from MCS: ref #624767
2018-11-25 18:00:48 [DEBUG   ] summary = ERROR
2018-11-25 18:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624767  13 58447 64848445 A  ERRORERROR'
2018-11-25 18:00:48 [DEBUG   ] Got command RPT from MCS: ref #624768
2018-11-25 18:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624768  77 58447 64848446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:00:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-25 18:01:18 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2018-11-25 18:01:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 18:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:01:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 18:01:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:01:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:01:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:01:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:01:19 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-25 18:01:38 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-11-25 18:01:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 18:02:18 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-11-25 18:02:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 18:02:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:02:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:02:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:02:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:02:19 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-25 18:02:22 [DEBUG   ] Got command RPT from MCS: ref #624786
2018-11-25 18:02:22 [DEBUG   ] summary = ERROR
2018-11-25 18:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624786  13 58447 64942581 A  ERRORERROR'
2018-11-25 18:02:22 [DEBUG   ] Got command RPT from MCS: ref #624787
2018-11-25 18:02:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624787  77 58447 64942773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:02:22 [DEBUG   ] Got command RPT from MCS: ref #624788
2018-11-25 18:02:22 [DEBUG   ] summary = ERROR
2018-11-25 18:02:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624788  13 58447 64942977 A  ERRORERROR'
2018-11-25 18:02:23 [DEBUG   ] Got command RPT from MCS: ref #624790
2018-11-25 18:02:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624790  77 58447 64943181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:02:23 [DEBUG   ] Got command RPT from MCS: ref #624792
2018-11-25 18:02:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624792  12 58447 64943385 A  ERRORB—™š'
2018-11-25 18:02:38 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-11-25 18:02:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 18:03:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 18:03:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:03:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:03:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:03:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:03:19 [WARNING ] (13, 1, 'bot')
2018-11-25 18:03:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:03:19 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-11-25 18:03:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-25 18:03:59 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-25 18:04:19 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2018-11-25 18:04:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:04:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:04:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:04:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:04:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:04:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:04:20 [DEBUG   ] Finished updating board flags in 2.074 seconds
2018-11-25 18:04:39 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-11-25 18:04:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 18:05:19 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-11-25 18:05:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:05:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:05:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:05:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:05:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:05:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:05:20 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-11-25 18:05:39 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-11-25 18:05:48 [DEBUG   ] Got command RPT from MCS: ref #624800
2018-11-25 18:05:48 [DEBUG   ] summary = ERROR
2018-11-25 18:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624800  13 58447 65148453 A  ERRORERROR'
2018-11-25 18:05:48 [DEBUG   ] Got command RPT from MCS: ref #624801
2018-11-25 18:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624801  77 58447 65148454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:05:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 18:06:19 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-11-25 18:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:06:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:06:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:06:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:06:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:06:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:06:20 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-25 18:06:39 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-11-25 18:06:59 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-25 18:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:07:20 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-25 18:07:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:07:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:07:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:07:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:07:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:07:20 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-25 18:07:22 [DEBUG   ] Got command RPT from MCS: ref #624821
2018-11-25 18:07:22 [DEBUG   ] summary = ERROR
2018-11-25 18:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624821  13 58447 65242665 A  ERRORERROR'
2018-11-25 18:07:22 [DEBUG   ] Got command RPT from MCS: ref #624822
2018-11-25 18:07:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624822  77 58447 65242857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:07:23 [DEBUG   ] Got command RPT from MCS: ref #624823
2018-11-25 18:07:23 [DEBUG   ] summary = ERROR
2018-11-25 18:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624823  13 58447 65243061 A  ERRORERROR'
2018-11-25 18:07:23 [DEBUG   ] Got command RPT from MCS: ref #624824
2018-11-25 18:07:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624824  77 58447 65243265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:07:23 [DEBUG   ] Got command RPT from MCS: ref #624825
2018-11-25 18:07:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624825  12 58447 65243469 A  ERRORB™™š'
2018-11-25 18:07:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-25 18:08:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-25 18:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:08:20 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2018-11-25 18:08:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:08:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:08:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:08:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:08:20 [DEBUG   ] Finished updating board flags in 1.673 seconds
2018-11-25 18:08:40 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-11-25 18:09:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 18:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:09:20 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-11-25 18:09:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:09:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:09:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:09:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:09:20 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-11-25 18:09:40 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-11-25 18:10:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:10:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 18:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:10:20 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-11-25 18:10:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:10:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:10:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:10:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:10:20 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-11-25 18:10:40 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-11-25 18:10:48 [DEBUG   ] Got command RPT from MCS: ref #624830
2018-11-25 18:10:48 [DEBUG   ] summary = ERROR
2018-11-25 18:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624830  13 58447 65448449 A  ERRORERROR'
2018-11-25 18:10:48 [DEBUG   ] Got command RPT from MCS: ref #624831
2018-11-25 18:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624831  77 58447 65448450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:11:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 18:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:11:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:11:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:11:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:11:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:11:20 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-11-25 18:11:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 18:11:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 18:12:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 18:12:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:12:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:12:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:12:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:12:20 [WARNING ] (13, 1, 'bot')
2018-11-25 18:12:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:12:20 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-11-25 18:12:21 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-25 18:12:22 [DEBUG   ] Got command RPT from MCS: ref #624849
2018-11-25 18:12:22 [DEBUG   ] summary = ERROR
2018-11-25 18:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624849  13 58447 65542749 A  ERRORERROR'
2018-11-25 18:12:22 [DEBUG   ] Got command RPT from MCS: ref #624850
2018-11-25 18:12:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624850  77 58447 65542941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:12:23 [DEBUG   ] Got command RPT from MCS: ref #624851
2018-11-25 18:12:23 [DEBUG   ] summary = ERROR
2018-11-25 18:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624851  13 58447 65543145 A  ERRORERROR'
2018-11-25 18:12:23 [DEBUG   ] Got command RPT from MCS: ref #624853
2018-11-25 18:12:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624853  77 58447 65543349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:12:23 [DEBUG   ] Got command RPT from MCS: ref #624854
2018-11-25 18:12:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624854  12 58447 65543553 A  ERRORB˜™š'
2018-11-25 18:12:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:13:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 18:13:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:13:21 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2018-11-25 18:13:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:13:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:13:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:13:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:13:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:13:21 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-11-25 18:13:41 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-11-25 18:14:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-25 18:14:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:14:21 [DEBUG   ] Finished updating ant stats in 0.639 seconds
2018-11-25 18:14:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:14:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:14:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:14:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:14:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:14:21 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-11-25 18:14:41 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-11-25 18:15:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 18:15:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:15:21 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-11-25 18:15:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:15:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:15:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:15:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:15:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:15:21 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-11-25 18:15:42 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2018-11-25 18:15:48 [DEBUG   ] Got command RPT from MCS: ref #624867
2018-11-25 18:15:48 [DEBUG   ] summary = ERROR
2018-11-25 18:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624867  13 58447 65748453 A  ERRORERROR'
2018-11-25 18:15:48 [DEBUG   ] Got command RPT from MCS: ref #624868
2018-11-25 18:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624868  77 58447 65748454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:16:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 18:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 18:16:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:16:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:16:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:16:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:16:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:16:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:16:21 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-11-25 18:16:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 18:16:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 18:17:03 [DEBUG   ] Finished updating ant stats in 2.195 seconds
2018-11-25 18:17:11 [DEBUG   ] Got command TBW from MCS: ref #624885
2018-11-25 18:17:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-11-25 18:17:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   624885   8 58447 65831489 A  ERROR'
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-11-25 18:17:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-11-25 18:17:14 [DEBUG   ] spawn_process: at 2018-11-25 18:17:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-11-25 18:17:15 [DEBUG   ] spawn_process: at 2018-11-25 18:17:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-11-25 18:17:15 [INFO    ] Finished spawning TBW
2018-11-25 18:17:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:17:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:17:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:17:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:17:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:17:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:17:21 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-11-25 18:17:22 [DEBUG   ] Got command RPT from MCS: ref #624887
2018-11-25 18:17:22 [DEBUG   ] summary = ERROR
2018-11-25 18:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624887  13 58447 65842837 A  ERRORERROR'
2018-11-25 18:17:23 [DEBUG   ] Got command RPT from MCS: ref #624888
2018-11-25 18:17:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624888  77 58447 65843029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:17:23 [DEBUG   ] Got command RPT from MCS: ref #624889
2018-11-25 18:17:23 [DEBUG   ] summary = ERROR
2018-11-25 18:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624889  13 58447 65843233 A  ERRORERROR'
2018-11-25 18:17:23 [DEBUG   ] Got command RPT from MCS: ref #624890
2018-11-25 18:17:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624890  77 58447 65843437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:17:23 [DEBUG   ] Got command RPT from MCS: ref #624891
2018-11-25 18:17:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624891  12 58447 65843629 A  ERRORB˜™š'
2018-11-25 18:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:18:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:18:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:18:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:18:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:18:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:18:21 [DEBUG   ] Finished updating board flags in 1.722 seconds
2018-11-25 18:19:03 [INFO    ] __waitForTBW - TBW finished in 108.869 s
2018-11-25 18:19:04 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-11-25 18:19:04 [INFO    ] Started antennas statistics background thread
2018-11-25 18:19:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1543169946']
2018-11-25 18:19:04 [DEBUG   ] spawn_process: at 2018-11-25 18:19:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1543169946']
2018-11-25 18:19:04 [INFO    ] Finished spawning TBN in 0.048 s
2018-11-25 18:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 18:19:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:19:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:19:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:19:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:19:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:19:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:19:21 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-11-25 18:19:25 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2018-11-25 18:19:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 18:20:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 18:20:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 18:20:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:20:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:20:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:20:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:20:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:20:21 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-11-25 18:20:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 18:20:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 18:20:48 [DEBUG   ] Got command RPT from MCS: ref #624902
2018-11-25 18:20:48 [DEBUG   ] summary = ERROR
2018-11-25 18:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624902  13 58447 66048453 A  ERRORERROR'
2018-11-25 18:20:48 [DEBUG   ] Got command RPT from MCS: ref #624903
2018-11-25 18:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624903  77 58447 66048454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:21:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 18:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:21:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:21:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:21:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:21:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:21:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:21:21 [DEBUG   ] Finished updating board flags in 1.642 seconds
2018-11-25 18:21:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 18:21:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:22:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 18:22:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:22:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:22:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:22:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:22:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:22:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:22:21 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-11-25 18:22:22 [DEBUG   ] Got command RPT from MCS: ref #624925
2018-11-25 18:22:22 [DEBUG   ] summary = ERROR
2018-11-25 18:22:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624925  13 58447 66142917 A  ERRORERROR'
2018-11-25 18:22:23 [DEBUG   ] Got command RPT from MCS: ref #624926
2018-11-25 18:22:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624926  77 58447 66143121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:22:23 [DEBUG   ] Got command RPT from MCS: ref #624927
2018-11-25 18:22:23 [DEBUG   ] summary = ERROR
2018-11-25 18:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624927  13 58447 66143313 A  ERRORERROR'
2018-11-25 18:22:23 [DEBUG   ] Got command RPT from MCS: ref #624929
2018-11-25 18:22:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624929  77 58447 66143517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:22:23 [DEBUG   ] Got command RPT from MCS: ref #624930
2018-11-25 18:22:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624930  12 58447 66143721 A  ERRORB™™š'
2018-11-25 18:22:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 18:22:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 18:23:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 18:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:23:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:23:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:23:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:23:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:23:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:23:21 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-11-25 18:23:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 18:23:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 18:24:05 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-25 18:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 18:24:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:24:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 18:24:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:24:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:24:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:24:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:24:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:24:21 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-11-25 18:24:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-25 18:24:46 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-25 18:25:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 18:25:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:25:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:25:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:25:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:25:21 [WARNING ] (13, 1, 'bot')
2018-11-25 18:25:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:25:21 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-11-25 18:25:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:25:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 18:25:48 [DEBUG   ] Got command RPT from MCS: ref #624939
2018-11-25 18:25:48 [DEBUG   ] summary = ERROR
2018-11-25 18:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624939  13 58447 66348465 A  ERRORERROR'
2018-11-25 18:25:48 [DEBUG   ] Got command RPT from MCS: ref #624940
2018-11-25 18:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624940  77 58447 66348466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:26:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 18:26:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:26:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:26:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:26:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:26:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:26:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:26:22 [DEBUG   ] Finished updating board flags in 1.647 seconds
2018-11-25 18:26:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 18:26:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 18:27:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 18:27:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:27:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:27:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:27:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:27:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:27:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:27:22 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-11-25 18:27:23 [DEBUG   ] Got command RPT from MCS: ref #624956
2018-11-25 18:27:23 [DEBUG   ] summary = ERROR
2018-11-25 18:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624956  13 58447 66443001 A  ERRORERROR'
2018-11-25 18:27:23 [DEBUG   ] Got command RPT from MCS: ref #624957
2018-11-25 18:27:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624957  77 58447 66443205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:27:23 [DEBUG   ] Got command RPT from MCS: ref #624958
2018-11-25 18:27:23 [DEBUG   ] summary = ERROR
2018-11-25 18:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624958  13 58447 66443409 A  ERRORERROR'
2018-11-25 18:27:23 [DEBUG   ] Got command RPT from MCS: ref #624959
2018-11-25 18:27:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624959  77 58447 66443601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:27:23 [DEBUG   ] Got command RPT from MCS: ref #624960
2018-11-25 18:27:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624960  12 58447 66443805 A  ERRORB˜™š'
2018-11-25 18:27:26 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-25 18:27:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 18:28:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 18:28:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:28:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:28:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:28:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:28:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:28:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:28:22 [DEBUG   ] Finished updating board flags in 2.344 seconds
2018-11-25 18:28:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-25 18:28:46 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-11-25 18:29:07 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-25 18:29:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:29:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 18:29:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:29:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:29:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:29:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:29:22 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-11-25 18:29:27 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 18:29:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 18:30:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 18:30:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:30:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:30:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:30:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:30:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:30:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:30:22 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-25 18:30:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 18:30:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-25 18:30:48 [DEBUG   ] Got command RPT from MCS: ref #624969
2018-11-25 18:30:48 [DEBUG   ] summary = ERROR
2018-11-25 18:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624969  13 58447 66648461 A  ERRORERROR'
2018-11-25 18:30:48 [DEBUG   ] Got command RPT from MCS: ref #624970
2018-11-25 18:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624970  77 58447 66648462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:31:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 18:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 18:31:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:31:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:31:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:31:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:31:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:31:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:31:22 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-11-25 18:31:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:31:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 18:32:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 18:32:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:32:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:32:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:32:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:32:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:32:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:32:22 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-25 18:32:23 [DEBUG   ] Got command RPT from MCS: ref #624988
2018-11-25 18:32:23 [DEBUG   ] summary = ERROR
2018-11-25 18:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624988  13 58447 66743085 A  ERRORERROR'
2018-11-25 18:32:23 [DEBUG   ] Got command RPT from MCS: ref #624989
2018-11-25 18:32:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624989  77 58447 66743289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:32:23 [DEBUG   ] Got command RPT from MCS: ref #624990
2018-11-25 18:32:23 [DEBUG   ] summary = ERROR
2018-11-25 18:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624990  13 58447 66743481 A  ERRORERROR'
2018-11-25 18:32:23 [DEBUG   ] Got command RPT from MCS: ref #624991
2018-11-25 18:32:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624991  77 58447 66743685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:32:23 [DEBUG   ] Got command RPT from MCS: ref #624993
2018-11-25 18:32:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   624993  12 58447 66743889 A  ERRORB˜™š'
2018-11-25 18:32:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 18:32:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 18:33:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 18:33:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:33:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:33:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:33:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:33:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:33:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:33:22 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-25 18:33:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-25 18:33:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 18:34:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-25 18:34:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:34:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:34:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:34:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:34:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:34:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:34:22 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-11-25 18:34:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-25 18:34:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 18:35:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 18:35:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 18:35:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:35:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:35:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:35:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:35:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:35:22 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-11-25 18:35:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 18:35:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 18:35:48 [DEBUG   ] Got command RPT from MCS: ref #625002
2018-11-25 18:35:48 [DEBUG   ] summary = ERROR
2018-11-25 18:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625002  13 58447 66948457 A  ERRORERROR'
2018-11-25 18:35:48 [DEBUG   ] Got command RPT from MCS: ref #625003
2018-11-25 18:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625003  77 58447 66948458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:36:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-25 18:36:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:36:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:36:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:36:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:36:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:36:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:36:22 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-11-25 18:36:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 18:36:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-25 18:37:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 18:37:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:37:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:37:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:37:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:37:22 [WARNING ] (13, 1, 'bot')
2018-11-25 18:37:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:37:22 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-25 18:37:23 [DEBUG   ] Got command RPT from MCS: ref #625023
2018-11-25 18:37:23 [DEBUG   ] summary = ERROR
2018-11-25 18:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625023  13 58447 67043169 A  ERRORERROR'
2018-11-25 18:37:23 [DEBUG   ] Got command RPT from MCS: ref #625024
2018-11-25 18:37:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625024  77 58447 67043373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:37:23 [DEBUG   ] Got command RPT from MCS: ref #625025
2018-11-25 18:37:23 [DEBUG   ] summary = ERROR
2018-11-25 18:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625025  13 58447 67043565 A  ERRORERROR'
2018-11-25 18:37:23 [DEBUG   ] Got command RPT from MCS: ref #625026
2018-11-25 18:37:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625026  77 58447 67043769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:37:23 [DEBUG   ] Got command RPT from MCS: ref #625027
2018-11-25 18:37:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:37:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625027  12 58447 67043973 A  ERRORB˜™š'
2018-11-25 18:37:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 18:37:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 18:38:00 [DEBUG   ] Got command RPT from MCS: ref #625028
2018-11-25 18:38:00 [DEBUG   ] summary = ERROR
2018-11-25 18:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625028  13 58447 67080921 A  ERRORERROR'
2018-11-25 18:38:00 [DEBUG   ] Got command RPT from MCS: ref #625029
2018-11-25 18:38:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625029  77 58447 67080922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:38:05 [DEBUG   ] Got command INI from MCS: ref #625030
2018-11-25 18:38:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-25 18:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   625030   8 58447 67085930 ABOOTING'
2018-11-25 18:38:09 [DEBUG   ] Finished updating ant stats in 1.239 seconds
2018-11-25 18:38:29 [INFO    ] -------------------
2018-11-25 18:38:29 [INFO    ]  LWA board status
2018-11-25 18:38:29 [INFO    ] -------------------
2018-11-25 18:38:29 [INFO    ] DP 1: 2 lwa27
2018-11-25 18:38:29 [INFO    ] DP 1: 3 lwa24
2018-11-25 18:38:29 [INFO    ] DP 1: 4 lwa23
2018-11-25 18:38:29 [INFO    ] DP 1: 5 lwa18
2018-11-25 18:38:29 [INFO    ] DP 1: 6 lwa10
2018-11-25 18:38:29 [INFO    ] DP 1: 7 lwa32
2018-11-25 18:38:29 [INFO    ] DP 1: 8 lwa11
2018-11-25 18:38:29 [INFO    ] DP 1: 9 lwa30
2018-11-25 18:38:29 [INFO    ] DP 1: 10 lwa12
2018-11-25 18:38:29 [INFO    ] DP 1: 11 lwa8
2018-11-25 18:38:29 [INFO    ] DP 1: 12 lwa13
2018-11-25 18:38:29 [INFO    ] DP 1: 13 lwa26
2018-11-25 18:38:29 [INFO    ] DP 1: 14 lwa14
2018-11-25 18:38:29 [INFO    ] DP 1: 16 lwa22
2018-11-25 18:38:29 [INFO    ] DP 1: 17 lwa20
2018-11-25 18:38:29 [INFO    ] DP 1: 18 lwa1
2018-11-25 18:38:29 [INFO    ] DP 1: 19 lwa5
2018-11-25 18:38:29 [INFO    ] DP 1: 20 lwa25
2018-11-25 18:38:29 [INFO    ] DP 1: 21 lwa35
2018-11-25 18:38:29 [INFO    ] DP 1: 22 lwa19
2018-11-25 18:38:29 [INFO    ] DP 1: 23 lwa21
2018-11-25 18:38:29 [INFO    ] DP 1: 24 lwa6
2018-11-25 18:38:29 [INFO    ] DP 1: 25 lwa7
2018-11-25 18:38:29 [INFO    ] DP 1: 26 lwa33
2018-11-25 18:38:29 [INFO    ] DP 1: 27 lwa15
2018-11-25 18:38:29 [INFO    ] DP 1: 28 lwa28
2018-11-25 18:38:29 [INFO    ] DP 2: 1 lwa16
2018-11-25 18:38:29 [INFO    ] DP 2: 15 lwa34
2018-11-25 18:38:29 [INFO    ] Total of 28 boards
2018-11-25 18:38:29 [INFO    ] Total of 260 stands
2018-11-25 18:38:29 [INFO    ] -------------------
2018-11-25 18:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19203
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19204
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19205
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19206
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19207
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19208
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19209
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19210
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19211
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19212
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19213
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19214
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19215
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19216
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19217
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19218
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19219
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19220
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19221
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19222
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19223
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19224
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19225
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19226
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19227
2018-11-25 18:38:36 [DEBUG   ] 2018-11-25 18:38:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19228
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19203 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19204 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19205 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19206 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19207 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19208 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19209 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19210 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19211 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19212 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19213 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19214 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19215 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19216 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19217 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19218 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19219 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19220 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19221 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19222 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19223 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19224 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19225 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19226 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19227 exited with status 0
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19228 exited with status 0
2018-11-25 18:38:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] spawn_process: at 2018-11-25 18:38:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19255
2018-11-25 18:38:49 [DEBUG   ] 2018-11-25 18:38:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19256
2018-11-25 18:38:54 [DEBUG   ] 2018-11-25 18:38:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19255 exited with status 0
2018-11-25 18:38:54 [DEBUG   ] 2018-11-25 18:38:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19256 exited with status 0
2018-11-25 18:38:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-25 18:38:54 [DEBUG   ] spawn_process: at 2018-11-25 18:38:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-25 18:38:54 [DEBUG   ] spawn_process: at 2018-11-25 18:38:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-25 18:38:54 [INFO    ] Setting Beam 1 xbars
2018-11-25 18:38:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-25 18:38:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-25 18:38:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-25 18:38:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-25 18:38:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-25 18:38:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-25 18:38:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-25 18:38:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-25 18:38:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-25 18:38:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-25 18:38:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-25 18:38:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-25 18:38:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-25 18:38:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-25 18:38:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-25 18:38:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-25 18:39:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-25 18:39:00 [INFO    ] Setting Beam 2 xbars
2018-11-25 18:39:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-25 18:39:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-25 18:39:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-25 18:39:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-25 18:39:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-25 18:39:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-25 18:39:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-25 18:39:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-25 18:39:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-25 18:39:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-25 18:39:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-25 18:39:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-25 18:39:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-25 18:39:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-25 18:39:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-25 18:39:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-25 18:39:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-25 18:39:05 [INFO    ] Setting Beam 3 xbars
2018-11-25 18:39:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-25 18:39:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-25 18:39:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-25 18:39:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-25 18:39:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-25 18:39:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-25 18:39:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-25 18:39:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-25 18:39:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-25 18:39:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-25 18:39:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-25 18:39:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-25 18:39:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-25 18:39:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-25 18:39:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-25 18:39:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-25 18:39:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-25 18:39:10 [INFO    ] Setting Beam 4 xbars
2018-11-25 18:39:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-25 18:39:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-25 18:39:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-25 18:39:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-25 18:39:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-25 18:39:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-25 18:39:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-25 18:39:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-25 18:39:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-25 18:39:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-25 18:39:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-25 18:39:16 [INFO    ] All xbars set
2018-11-25 18:39:16 [INFO    ] Setting adder chain routing for all beams
2018-11-25 18:39:21 [INFO    ] Setting beam ids
2018-11-25 18:39:31 [INFO    ] Starting beam delay calibration
2018-11-25 18:39:43 [INFO    ] Beam 1 latency is 5742
2018-11-25 18:39:43 [INFO    ] Beam 2 latency is 5732
2018-11-25 18:39:43 [INFO    ] Beam 3 latency is 5721
2018-11-25 18:39:43 [INFO    ] Beam 4 latency is 5733
2018-11-25 18:39:43 [INFO    ] Stop calibration
2018-11-25 18:39:51 [INFO    ] Beam delay calibration successful
2018-11-25 18:39:51 [INFO    ] Calibration passed
2018-11-25 18:39:51 [DEBUG   ] spawn_process: at 2018-11-25 18:39:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-25 18:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-25 18:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-25 18:39:51 [DEBUG   ] spawn_process: at 2018-11-25 18:39:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-25 18:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-25 18:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-25 18:39:51 [DEBUG   ] spawn_process: at 2018-11-25 18:39:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-25 18:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-25 18:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-25 18:39:51 [DEBUG   ] spawn_process: at 2018-11-25 18:39:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-25 18:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-25 18:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-25 18:39:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-25 18:39:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 292 ms (1543171192.294 s) with PID 20844 and time 1543171193
2018-11-25 18:39:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-25 18:39:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 380 ms (1543171192.383 s) with PID 20847 and time 1543171193
2018-11-25 18:39:53 [DEBUG   ] Finished updating ant stats in 0.865 seconds
2018-11-25 18:39:53 [INFO    ] Started antennas statistics background thread
2018-11-25 18:39:53 [INFO    ] Started board flags background thread
2018-11-25 18:39:53 [INFO    ] Started BAM background thread
2018-11-25 18:39:53 [INFO    ] Finished the INI process (ref. #625030) in 107.577 s
2018-11-25 18:39:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:39:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:39:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:39:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:39:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:39:54 [DEBUG   ] Finished updating board flags in 1.050 seconds
2018-11-25 18:40:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:40:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:40:48 [DEBUG   ] Got command RPT from MCS: ref #625035
2018-11-25 18:40:48 [DEBUG   ] summary = ERROR
2018-11-25 18:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625035  13 58447 67248461 A  ERRORERROR'
2018-11-25 18:40:48 [DEBUG   ] Got command RPT from MCS: ref #625036
2018-11-25 18:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625036  77 58447 67248462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:40:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:40:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:40:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:40:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:40:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:40:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:40:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:40:54 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-25 18:41:05 [DEBUG   ] Got command RPT from MCS: ref #625052
2018-11-25 18:41:05 [DEBUG   ] summary = ERROR
2018-11-25 18:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625052  13 58447 67265933 A  ERRORERROR'
2018-11-25 18:41:05 [DEBUG   ] Got command RPT from MCS: ref #625053
2018-11-25 18:41:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625053  77 58447 67265934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:41:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:41:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 18:41:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 18:41:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 18:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 18:41:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:41:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:41:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:41:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:41:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:41:54 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-11-25 18:42:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 18:42:23 [DEBUG   ] Got command RPT from MCS: ref #625056
2018-11-25 18:42:23 [DEBUG   ] summary = ERROR
2018-11-25 18:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625056  13 58447 67343250 A  ERRORERROR'
2018-11-25 18:42:23 [DEBUG   ] Got command RPT from MCS: ref #625057
2018-11-25 18:42:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625057  77 58447 67343453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:42:23 [DEBUG   ] Got command RPT from MCS: ref #625058
2018-11-25 18:42:23 [DEBUG   ] summary = ERROR
2018-11-25 18:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625058  13 58447 67343657 A  ERRORERROR'
2018-11-25 18:42:23 [DEBUG   ] Got command RPT from MCS: ref #625060
2018-11-25 18:42:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:42:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625060  77 58447 67343861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:42:24 [DEBUG   ] Got command RPT from MCS: ref #625062
2018-11-25 18:42:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625062  12 58447 67344053 A  ERRORB˜™š'
2018-11-25 18:42:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 18:42:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 18:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:42:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 18:42:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:42:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:42:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:42:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:42:55 [DEBUG   ] Finished updating board flags in 1.881 seconds
2018-11-25 18:43:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 18:43:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 18:43:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 18:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:43:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:43:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:43:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:43:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:43:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:43:55 [DEBUG   ] Finished updating board flags in 1.722 seconds
2018-11-25 18:44:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 18:44:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 18:44:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 18:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:44:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:44:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:44:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:44:54 [WARNING ] (13, 1, 'bot')
2018-11-25 18:44:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:44:54 [DEBUG   ] Finished updating board flags in 1.054 seconds
2018-11-25 18:45:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 18:45:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 18:45:48 [DEBUG   ] Got command RPT from MCS: ref #625074
2018-11-25 18:45:48 [DEBUG   ] summary = ERROR
2018-11-25 18:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625074  13 58447 67548469 A  ERRORERROR'
2018-11-25 18:45:48 [DEBUG   ] Got command RPT from MCS: ref #625075
2018-11-25 18:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625075  77 58447 67548470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:45:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 18:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:45:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:45:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:45:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:45:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:45:55 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-11-25 18:46:13 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 18:46:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 18:46:54 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2018-11-25 18:46:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:46:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:46:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:46:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:46:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:46:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:46:55 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-11-25 18:47:14 [DEBUG   ] Finished updating ant stats in 1.166 seconds
2018-11-25 18:47:23 [DEBUG   ] Got command RPT from MCS: ref #625091
2018-11-25 18:47:23 [DEBUG   ] summary = ERROR
2018-11-25 18:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625091  13 58447 67643341 A  ERRORERROR'
2018-11-25 18:47:23 [DEBUG   ] Got command RPT from MCS: ref #625092
2018-11-25 18:47:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625092  77 58447 67643545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:47:23 [DEBUG   ] Got command RPT from MCS: ref #625093
2018-11-25 18:47:23 [DEBUG   ] summary = ERROR
2018-11-25 18:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625093  13 58447 67643737 A  ERRORERROR'
2018-11-25 18:47:23 [DEBUG   ] Got command RPT from MCS: ref #625094
2018-11-25 18:47:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:47:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625094  77 58447 67643963 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:47:24 [DEBUG   ] Got command RPT from MCS: ref #625095
2018-11-25 18:47:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625095  12 58447 67644141 A  ERRORB˜™š'
2018-11-25 18:47:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 18:47:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 18:47:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:47:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:47:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:47:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:47:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:47:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:47:55 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-11-25 18:48:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 18:48:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:48:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:48:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:48:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:48:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:48:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:48:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:48:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:48:55 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-11-25 18:49:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:49:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:49:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:49:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 18:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:49:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:49:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:49:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:49:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:49:55 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-25 18:50:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:50:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:50:48 [DEBUG   ] Got command RPT from MCS: ref #625100
2018-11-25 18:50:48 [DEBUG   ] summary = ERROR
2018-11-25 18:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625100  13 58447 67848461 A  ERRORERROR'
2018-11-25 18:50:48 [DEBUG   ] Got command RPT from MCS: ref #625101
2018-11-25 18:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625101  77 58447 67848462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:50:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 18:50:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:50:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:50:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:50:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:50:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:50:55 [DEBUG   ] Finished updating board flags in 1.054 seconds
2018-11-25 18:51:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:51:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:51:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:51:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 18:51:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 18:51:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:51:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:51:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:51:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:51:56 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-25 18:52:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:52:23 [DEBUG   ] Got command RPT from MCS: ref #625123
2018-11-25 18:52:23 [DEBUG   ] summary = ERROR
2018-11-25 18:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625123  13 58447 67943421 A  ERRORERROR'
2018-11-25 18:52:23 [DEBUG   ] Got command RPT from MCS: ref #625124
2018-11-25 18:52:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625124  77 58447 67943625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:52:23 [DEBUG   ] Got command RPT from MCS: ref #625125
2018-11-25 18:52:23 [DEBUG   ] summary = ERROR
2018-11-25 18:52:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625125  13 58447 67943829 A  ERRORERROR'
2018-11-25 18:52:24 [DEBUG   ] Got command RPT from MCS: ref #625127
2018-11-25 18:52:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625127  77 58447 67944033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:52:24 [DEBUG   ] Got command RPT from MCS: ref #625128
2018-11-25 18:52:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625128  12 58447 67944225 A  ERRORB™™š'
2018-11-25 18:52:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:52:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:52:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:52:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:52:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:52:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:52:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:52:56 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-25 18:53:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:53:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:53:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:53:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:53:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:53:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:53:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:53:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:53:55 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-25 18:54:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:54:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:54:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:54:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:54:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:54:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:54:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:54:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:54:55 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-25 18:55:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:55:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:55:48 [DEBUG   ] Got command RPT from MCS: ref #625137
2018-11-25 18:55:48 [DEBUG   ] summary = ERROR
2018-11-25 18:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625137  13 58447 68148461 A  ERRORERROR'
2018-11-25 18:55:48 [DEBUG   ] Got command RPT from MCS: ref #625138
2018-11-25 18:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625138  77 58447 68148462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:55:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:55:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 18:55:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:55:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:55:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:55:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:55:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:55:55 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-11-25 18:56:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:56:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:56:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:56:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:56:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:56:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:56:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:56:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:56:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:56:55 [DEBUG   ] Finished updating board flags in 1.150 seconds
2018-11-25 18:57:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:57:23 [DEBUG   ] Got command RPT from MCS: ref #625154
2018-11-25 18:57:23 [DEBUG   ] summary = ERROR
2018-11-25 18:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625154  13 58447 68243513 A  ERRORERROR'
2018-11-25 18:57:23 [DEBUG   ] Got command RPT from MCS: ref #625155
2018-11-25 18:57:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625155  77 58447 68243709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:57:23 [DEBUG   ] Got command RPT from MCS: ref #625156
2018-11-25 18:57:23 [DEBUG   ] summary = ERROR
2018-11-25 18:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625156  13 58447 68243913 A  ERRORERROR'
2018-11-25 18:57:24 [DEBUG   ] Got command RPT from MCS: ref #625157
2018-11-25 18:57:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 18:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625157  77 58447 68244117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 18:57:24 [DEBUG   ] Got command RPT from MCS: ref #625158
2018-11-25 18:57:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 18:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625158  12 58447 68244309 A  ERRORB™™š'
2018-11-25 18:57:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:57:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 18:57:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:57:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:57:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:57:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:57:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:57:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:57:56 [DEBUG   ] Finished updating board flags in 1.652 seconds
2018-11-25 18:58:07 [DEBUG   ] Got command BAM from MCS: ref #625168
2018-11-25 18:58:07 [INFO    ] Finished processing BAM request
2018-11-25 18:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625168   8 58447 68287033 A  ERROR'
2018-11-25 18:58:07 [DEBUG   ] Got command BAM from MCS: ref #625167
2018-11-25 18:58:07 [INFO    ] Finished processing BAM request
2018-11-25 18:58:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625167   8 58447 68287037 A  ERROR'
2018-11-25 18:58:07 [DEBUG   ] Got command DRX from MCS: ref #625169
2018-11-25 18:58:07 [INFO    ] sending drx command to lwa16
2018-11-25 18:58:07 [DEBUG   ] run_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 9']
2018-11-25 18:58:07 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-25 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   625169   8 58447 68287102 A  ERROR'
2018-11-25 18:58:07 [DEBUG   ] Got command DRX from MCS: ref #625170
2018-11-25 18:58:07 [INFO    ] sending drx command to lwa16
2018-11-25 18:58:07 [DEBUG   ] run_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 35100000.0 7 9 9']
2018-11-25 18:58:07 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-25 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   625170   8 58447 68287106 A  ERROR'
2018-11-25 18:58:07 [DEBUG   ] Got command DRX from MCS: ref #625171
2018-11-25 18:58:07 [INFO    ] sending drx command to lwa16
2018-11-25 18:58:07 [DEBUG   ] run_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 9']
2018-11-25 18:58:07 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-25 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   625171   8 58447 68287110 A  ERROR'
2018-11-25 18:58:07 [DEBUG   ] Got command DRX from MCS: ref #625172
2018-11-25 18:58:07 [INFO    ] sending drx command to lwa16
2018-11-25 18:58:07 [DEBUG   ] run_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 49800000.0 7 9 9']
2018-11-25 18:58:07 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-25 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   625172   8 58447 68287114 A  ERROR'
2018-11-25 18:58:07 [INFO    ] Finished starting DRX
2018-11-25 18:58:07 [INFO    ] Finished starting DRX
2018-11-25 18:58:07 [INFO    ] Finished starting DRX
2018-11-25 18:58:07 [INFO    ] Finished starting DRX
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 18:58:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 18:58:07 [DEBUG   ] spawn_process: at 2018-11-25 18:58:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 18:58:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 18:58:20 [DEBUG   ] Got command BAM from MCS: ref #625175
2018-11-25 18:58:20 [INFO    ] Finished processing BAM request
2018-11-25 18:58:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625175   8 58447 68300033 A  ERROR'
2018-11-25 18:58:20 [DEBUG   ] Got command BAM from MCS: ref #625176
2018-11-25 18:58:20 [INFO    ] Finished processing BAM request
2018-11-25 18:58:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625176   8 58447 68300037 A  ERROR'
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 18:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 18:58:20 [DEBUG   ] spawn_process: at 2018-11-25 18:58:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 18:58:33 [DEBUG   ] Got command BAM from MCS: ref #625177
2018-11-25 18:58:33 [INFO    ] Finished processing BAM request
2018-11-25 18:58:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625177   8 58447 68313025 A  ERROR'
2018-11-25 18:58:33 [DEBUG   ] Got command BAM from MCS: ref #625178
2018-11-25 18:58:33 [INFO    ] Finished processing BAM request
2018-11-25 18:58:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625178   8 58447 68313029 A  ERROR'
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 18:58:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 18:58:33 [DEBUG   ] spawn_process: at 2018-11-25 18:58:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 18:58:34 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-25 18:58:46 [DEBUG   ] Got command BAM from MCS: ref #625179
2018-11-25 18:58:46 [INFO    ] Finished processing BAM request
2018-11-25 18:58:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625179   8 58447 68326025 A  ERROR'
2018-11-25 18:58:46 [DEBUG   ] Got command BAM from MCS: ref #625180
2018-11-25 18:58:46 [INFO    ] Finished processing BAM request
2018-11-25 18:58:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625180   8 58447 68326029 A  ERROR'
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 18:58:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 18:58:46 [DEBUG   ] spawn_process: at 2018-11-25 18:58:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 18:58:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 18:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 18:58:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:58:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:58:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:58:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:58:55 [WARNING ] (13, 1, 'bot')
2018-11-25 18:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:58:55 [DEBUG   ] Finished updating board flags in 0.958 seconds
2018-11-25 18:58:59 [DEBUG   ] Got command BAM from MCS: ref #625182
2018-11-25 18:58:59 [INFO    ] Finished processing BAM request
2018-11-25 18:58:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625182   8 58447 68339029 A  ERROR'
2018-11-25 18:58:59 [DEBUG   ] Got command BAM from MCS: ref #625181
2018-11-25 18:58:59 [INFO    ] Finished processing BAM request
2018-11-25 18:58:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625181   8 58447 68339033 A  ERROR'
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 18:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 18:58:59 [DEBUG   ] spawn_process: at 2018-11-25 18:58:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 18:59:12 [DEBUG   ] Got command BAM from MCS: ref #625184
2018-11-25 18:59:12 [INFO    ] Finished processing BAM request
2018-11-25 18:59:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:59:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625184   8 58447 68352025 A  ERROR'
2018-11-25 18:59:12 [DEBUG   ] Got command BAM from MCS: ref #625183
2018-11-25 18:59:12 [INFO    ] Finished processing BAM request
2018-11-25 18:59:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:59:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625183   8 58447 68352029 A  ERROR'
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 18:59:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 18:59:12 [DEBUG   ] spawn_process: at 2018-11-25 18:59:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 18:59:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 18:59:25 [DEBUG   ] Got command BAM from MCS: ref #625186
2018-11-25 18:59:25 [INFO    ] Finished processing BAM request
2018-11-25 18:59:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625186   8 58447 68365029 A  ERROR'
2018-11-25 18:59:25 [DEBUG   ] Got command BAM from MCS: ref #625185
2018-11-25 18:59:25 [INFO    ] Finished processing BAM request
2018-11-25 18:59:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625185   8 58447 68365033 A  ERROR'
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 18:59:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 18:59:25 [DEBUG   ] spawn_process: at 2018-11-25 18:59:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 18:59:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 18:59:38 [DEBUG   ] Got command BAM from MCS: ref #625188
2018-11-25 18:59:38 [INFO    ] Finished processing BAM request
2018-11-25 18:59:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625188   8 58447 68378033 A  ERROR'
2018-11-25 18:59:38 [DEBUG   ] Got command BAM from MCS: ref #625187
2018-11-25 18:59:38 [INFO    ] Finished processing BAM request
2018-11-25 18:59:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625187   8 58447 68378037 A  ERROR'
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 18:59:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 18:59:38 [DEBUG   ] spawn_process: at 2018-11-25 18:59:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 18:59:51 [DEBUG   ] Got command BAM from MCS: ref #625189
2018-11-25 18:59:51 [INFO    ] Finished processing BAM request
2018-11-25 18:59:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625189   8 58447 68391025 A  ERROR'
2018-11-25 18:59:51 [DEBUG   ] Got command BAM from MCS: ref #625190
2018-11-25 18:59:51 [INFO    ] Finished processing BAM request
2018-11-25 18:59:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 18:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625190   8 58447 68391029 A  ERROR'
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 18:59:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 18:59:51 [DEBUG   ] spawn_process: at 2018-11-25 18:59:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 18:59:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 18:59:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 18:59:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 18:59:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:59:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:59:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:59:56 [WARNING ] (13, 1, 'bot')
2018-11-25 18:59:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 18:59:56 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-11-25 19:00:04 [DEBUG   ] Got command BAM from MCS: ref #625192
2018-11-25 19:00:04 [INFO    ] Finished processing BAM request
2018-11-25 19:00:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625192   8 58447 68404033 A  ERROR'
2018-11-25 19:00:04 [DEBUG   ] Got command BAM from MCS: ref #625191
2018-11-25 19:00:04 [INFO    ] Finished processing BAM request
2018-11-25 19:00:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625191   8 58447 68404037 A  ERROR'
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:00:04 [DEBUG   ] spawn_process: at 2018-11-25 19:00:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:00:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:00:17 [DEBUG   ] Got command BAM from MCS: ref #625193
2018-11-25 19:00:17 [INFO    ] Finished processing BAM request
2018-11-25 19:00:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625193   8 58447 68417029 A  ERROR'
2018-11-25 19:00:17 [DEBUG   ] Got command BAM from MCS: ref #625194
2018-11-25 19:00:17 [INFO    ] Finished processing BAM request
2018-11-25 19:00:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625194   8 58447 68417033 A  ERROR'
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:00:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:00:17 [DEBUG   ] spawn_process: at 2018-11-25 19:00:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:00:30 [DEBUG   ] Got command BAM from MCS: ref #625196
2018-11-25 19:00:30 [INFO    ] Finished processing BAM request
2018-11-25 19:00:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625196   8 58447 68430033 A  ERROR'
2018-11-25 19:00:30 [DEBUG   ] Got command BAM from MCS: ref #625195
2018-11-25 19:00:30 [INFO    ] Finished processing BAM request
2018-11-25 19:00:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625195   8 58447 68430037 A  ERROR'
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:00:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:00:30 [DEBUG   ] spawn_process: at 2018-11-25 19:00:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:00:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:00:43 [DEBUG   ] Got command BAM from MCS: ref #625201
2018-11-25 19:00:43 [INFO    ] Finished processing BAM request
2018-11-25 19:00:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625201   8 58447 68443029 A  ERROR'
2018-11-25 19:00:43 [DEBUG   ] Got command BAM from MCS: ref #625202
2018-11-25 19:00:43 [INFO    ] Finished processing BAM request
2018-11-25 19:00:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625202   8 58447 68443033 A  ERROR'
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:00:43 [DEBUG   ] spawn_process: at 2018-11-25 19:00:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:00:48 [DEBUG   ] Got command RPT from MCS: ref #625203
2018-11-25 19:00:48 [DEBUG   ] summary = ERROR
2018-11-25 19:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625203  13 58447 68448469 A  ERRORERROR'
2018-11-25 19:00:48 [DEBUG   ] Got command RPT from MCS: ref #625204
2018-11-25 19:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625204  77 58447 68448470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:00:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:00:55 [DEBUG   ] Got command BAM from MCS: ref #625220
2018-11-25 19:00:55 [INFO    ] Finished processing BAM request
2018-11-25 19:00:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625220   8 58447 68455029 A  ERROR'
2018-11-25 19:00:55 [DEBUG   ] Got command BAM from MCS: ref #625221
2018-11-25 19:00:55 [INFO    ] Finished processing BAM request
2018-11-25 19:00:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:00:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625221   8 58447 68455033 A  ERROR'
2018-11-25 19:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 19:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 19:00:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:00:55 [DEBUG   ] spawn_process: at 2018-11-25 19:00:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:00:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:00:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:00:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:00:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:00:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:00:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:00:56 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-11-25 19:01:07 [DEBUG   ] Got command BAM from MCS: ref #625222
2018-11-25 19:01:07 [INFO    ] Finished processing BAM request
2018-11-25 19:01:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625222   8 58447 68467033 A  ERROR'
2018-11-25 19:01:07 [DEBUG   ] Got command BAM from MCS: ref #625223
2018-11-25 19:01:07 [INFO    ] Finished processing BAM request
2018-11-25 19:01:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625223   8 58447 68467037 A  ERROR'
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:01:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:01:07 [DEBUG   ] spawn_process: at 2018-11-25 19:01:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:01:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:01:19 [DEBUG   ] Got command BAM from MCS: ref #625225
2018-11-25 19:01:19 [INFO    ] Finished processing BAM request
2018-11-25 19:01:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625225   8 58447 68479033 A  ERROR'
2018-11-25 19:01:19 [DEBUG   ] Got command BAM from MCS: ref #625224
2018-11-25 19:01:19 [INFO    ] Finished processing BAM request
2018-11-25 19:01:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625224   8 58447 68479037 A  ERROR'
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:01:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:01:19 [DEBUG   ] spawn_process: at 2018-11-25 19:01:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:01:31 [DEBUG   ] Got command BAM from MCS: ref #625227
2018-11-25 19:01:31 [INFO    ] Finished processing BAM request
2018-11-25 19:01:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625227   8 58447 68491029 A  ERROR'
2018-11-25 19:01:31 [DEBUG   ] Got command BAM from MCS: ref #625226
2018-11-25 19:01:31 [INFO    ] Finished processing BAM request
2018-11-25 19:01:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625226   8 58447 68491033 A  ERROR'
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:01:31 [DEBUG   ] spawn_process: at 2018-11-25 19:01:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:01:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:01:43 [DEBUG   ] Got command BAM from MCS: ref #625228
2018-11-25 19:01:43 [INFO    ] Finished processing BAM request
2018-11-25 19:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625228   8 58447 68503033 A  ERROR'
2018-11-25 19:01:43 [DEBUG   ] Got command BAM from MCS: ref #625229
2018-11-25 19:01:43 [INFO    ] Finished processing BAM request
2018-11-25 19:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625229   8 58447 68503037 A  ERROR'
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:01:43 [DEBUG   ] spawn_process: at 2018-11-25 19:01:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:01:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:01:55 [DEBUG   ] Got command BAM from MCS: ref #625231
2018-11-25 19:01:55 [INFO    ] Finished processing BAM request
2018-11-25 19:01:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625231   8 58447 68515033 A  ERROR'
2018-11-25 19:01:55 [DEBUG   ] Got command BAM from MCS: ref #625230
2018-11-25 19:01:55 [INFO    ] Finished processing BAM request
2018-11-25 19:01:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625230   8 58447 68515037 A  ERROR'
2018-11-25 19:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:01:55 [DEBUG   ] spawn_process: at 2018-11-25 19:01:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:01:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:01:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:01:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:01:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:01:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:01:56 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-25 19:02:07 [DEBUG   ] Got command BAM from MCS: ref #625234
2018-11-25 19:02:07 [INFO    ] Finished processing BAM request
2018-11-25 19:02:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625234   8 58447 68527025 A  ERROR'
2018-11-25 19:02:07 [DEBUG   ] Got command BAM from MCS: ref #625235
2018-11-25 19:02:07 [INFO    ] Finished processing BAM request
2018-11-25 19:02:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625235   8 58447 68527029 A  ERROR'
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:02:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:02:07 [DEBUG   ] spawn_process: at 2018-11-25 19:02:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:02:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 19:02:19 [DEBUG   ] Got command BAM from MCS: ref #625237
2018-11-25 19:02:19 [INFO    ] Finished processing BAM request
2018-11-25 19:02:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625237   8 58447 68539025 A  ERROR'
2018-11-25 19:02:19 [DEBUG   ] Got command BAM from MCS: ref #625236
2018-11-25 19:02:19 [INFO    ] Finished processing BAM request
2018-11-25 19:02:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625236   8 58447 68539029 A  ERROR'
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:02:19 [DEBUG   ] spawn_process: at 2018-11-25 19:02:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:02:23 [DEBUG   ] Got command RPT from MCS: ref #625238
2018-11-25 19:02:23 [DEBUG   ] summary = ERROR
2018-11-25 19:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625238  13 58447 68543597 A  ERRORERROR'
2018-11-25 19:02:23 [DEBUG   ] Got command RPT from MCS: ref #625239
2018-11-25 19:02:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625239  77 58447 68543801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:02:23 [DEBUG   ] Got command RPT from MCS: ref #625240
2018-11-25 19:02:23 [DEBUG   ] summary = ERROR
2018-11-25 19:02:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625240  13 58447 68543993 A  ERRORERROR'
2018-11-25 19:02:24 [DEBUG   ] Got command RPT from MCS: ref #625242
2018-11-25 19:02:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625242  77 58447 68544197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:02:24 [DEBUG   ] Got command RPT from MCS: ref #625243
2018-11-25 19:02:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625243  12 58447 68544401 A  ERRORB¡ff'
2018-11-25 19:02:31 [DEBUG   ] Got command BAM from MCS: ref #625249
2018-11-25 19:02:31 [INFO    ] Finished processing BAM request
2018-11-25 19:02:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625249   8 58447 68551029 A  ERROR'
2018-11-25 19:02:31 [DEBUG   ] Got command BAM from MCS: ref #625248
2018-11-25 19:02:31 [INFO    ] Finished processing BAM request
2018-11-25 19:02:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625248   8 58447 68551033 A  ERROR'
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:02:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:02:31 [DEBUG   ] spawn_process: at 2018-11-25 19:02:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:02:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:02:43 [DEBUG   ] Got command BAM from MCS: ref #625250
2018-11-25 19:02:43 [INFO    ] Finished processing BAM request
2018-11-25 19:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625250   8 58447 68563029 A  ERROR'
2018-11-25 19:02:43 [DEBUG   ] Got command BAM from MCS: ref #625251
2018-11-25 19:02:43 [INFO    ] Finished processing BAM request
2018-11-25 19:02:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625251   8 58447 68563033 A  ERROR'
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:02:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:02:43 [DEBUG   ] spawn_process: at 2018-11-25 19:02:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:02:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:02:55 [DEBUG   ] Got command BAM from MCS: ref #625252
2018-11-25 19:02:55 [INFO    ] Finished processing BAM request
2018-11-25 19:02:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625252   8 58447 68575025 A  ERROR'
2018-11-25 19:02:55 [DEBUG   ] Got command BAM from MCS: ref #625253
2018-11-25 19:02:55 [INFO    ] Finished processing BAM request
2018-11-25 19:02:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:02:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625253   8 58447 68575029 A  ERROR'
2018-11-25 19:02:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 19:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:02:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:02:55 [DEBUG   ] spawn_process: at 2018-11-25 19:02:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:02:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:02:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:02:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:02:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:02:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:02:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:02:56 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-11-25 19:03:07 [DEBUG   ] Got command BAM from MCS: ref #625254
2018-11-25 19:03:07 [INFO    ] Finished processing BAM request
2018-11-25 19:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625254   8 58447 68587033 A  ERROR'
2018-11-25 19:03:07 [DEBUG   ] Got command BAM from MCS: ref #625255
2018-11-25 19:03:07 [INFO    ] Finished processing BAM request
2018-11-25 19:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625255   8 58447 68587041 A  ERROR'
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:03:07 [DEBUG   ] spawn_process: at 2018-11-25 19:03:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:03:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:03:19 [DEBUG   ] Got command BAM from MCS: ref #625257
2018-11-25 19:03:19 [INFO    ] Finished processing BAM request
2018-11-25 19:03:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625257   8 58447 68599029 A  ERROR'
2018-11-25 19:03:19 [DEBUG   ] Got command BAM from MCS: ref #625256
2018-11-25 19:03:19 [INFO    ] Finished processing BAM request
2018-11-25 19:03:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625256   8 58447 68599033 A  ERROR'
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:03:19 [DEBUG   ] spawn_process: at 2018-11-25 19:03:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:03:31 [DEBUG   ] Got command BAM from MCS: ref #625258
2018-11-25 19:03:31 [INFO    ] Finished processing BAM request
2018-11-25 19:03:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625258   8 58447 68611025 A  ERROR'
2018-11-25 19:03:31 [DEBUG   ] Got command BAM from MCS: ref #625259
2018-11-25 19:03:31 [INFO    ] Finished processing BAM request
2018-11-25 19:03:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625259   8 58447 68611033 A  ERROR'
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:03:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:03:31 [DEBUG   ] spawn_process: at 2018-11-25 19:03:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:03:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:03:43 [DEBUG   ] Got command BAM from MCS: ref #625264
2018-11-25 19:03:43 [INFO    ] Finished processing BAM request
2018-11-25 19:03:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625264   8 58447 68623033 A  ERROR'
2018-11-25 19:03:43 [DEBUG   ] Got command BAM from MCS: ref #625265
2018-11-25 19:03:43 [INFO    ] Finished processing BAM request
2018-11-25 19:03:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625265   8 58447 68623037 A  ERROR'
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:03:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:03:43 [DEBUG   ] spawn_process: at 2018-11-25 19:03:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:03:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:03:55 [DEBUG   ] Got command BAM from MCS: ref #625266
2018-11-25 19:03:55 [INFO    ] Finished processing BAM request
2018-11-25 19:03:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625266   8 58447 68635029 A  ERROR'
2018-11-25 19:03:55 [DEBUG   ] Got command BAM from MCS: ref #625267
2018-11-25 19:03:55 [INFO    ] Finished processing BAM request
2018-11-25 19:03:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625267   8 58447 68635033 A  ERROR'
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:03:55 [DEBUG   ] spawn_process: at 2018-11-25 19:03:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 19:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-25 19:03:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:03:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:03:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:03:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:03:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:03:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:03:56 [DEBUG   ] Finished updating board flags in 1.250 seconds
2018-11-25 19:04:07 [DEBUG   ] Got command BAM from MCS: ref #625268
2018-11-25 19:04:07 [INFO    ] Finished processing BAM request
2018-11-25 19:04:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625268   8 58447 68647033 A  ERROR'
2018-11-25 19:04:07 [DEBUG   ] Got command BAM from MCS: ref #625269
2018-11-25 19:04:07 [INFO    ] Finished processing BAM request
2018-11-25 19:04:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625269   8 58447 68647037 A  ERROR'
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:04:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:04:07 [DEBUG   ] spawn_process: at 2018-11-25 19:04:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:04:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:04:19 [DEBUG   ] Got command BAM from MCS: ref #625270
2018-11-25 19:04:19 [INFO    ] Finished processing BAM request
2018-11-25 19:04:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625270   8 58447 68659025 A  ERROR'
2018-11-25 19:04:19 [DEBUG   ] Got command BAM from MCS: ref #625271
2018-11-25 19:04:19 [INFO    ] Finished processing BAM request
2018-11-25 19:04:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625271   8 58447 68659029 A  ERROR'
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:04:19 [DEBUG   ] spawn_process: at 2018-11-25 19:04:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:04:31 [DEBUG   ] Got command BAM from MCS: ref #625272
2018-11-25 19:04:31 [INFO    ] Finished processing BAM request
2018-11-25 19:04:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625272   8 58447 68671029 A  ERROR'
2018-11-25 19:04:31 [DEBUG   ] Got command BAM from MCS: ref #625273
2018-11-25 19:04:31 [INFO    ] Finished processing BAM request
2018-11-25 19:04:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625273   8 58447 68671033 A  ERROR'
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:04:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:04:31 [DEBUG   ] spawn_process: at 2018-11-25 19:04:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:04:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:04:43 [DEBUG   ] Got command BAM from MCS: ref #625274
2018-11-25 19:04:43 [INFO    ] Finished processing BAM request
2018-11-25 19:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625274   8 58447 68683025 A  ERROR'
2018-11-25 19:04:43 [DEBUG   ] Got command BAM from MCS: ref #625275
2018-11-25 19:04:43 [INFO    ] Finished processing BAM request
2018-11-25 19:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625275   8 58447 68683029 A  ERROR'
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:04:43 [DEBUG   ] spawn_process: at 2018-11-25 19:04:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:04:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:04:55 [DEBUG   ] Got command BAM from MCS: ref #625277
2018-11-25 19:04:55 [INFO    ] Finished processing BAM request
2018-11-25 19:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625277   8 58447 68695033 A  ERROR'
2018-11-25 19:04:55 [DEBUG   ] Got command BAM from MCS: ref #625276
2018-11-25 19:04:55 [INFO    ] Finished processing BAM request
2018-11-25 19:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625276   8 58447 68695037 A  ERROR'
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:04:55 [DEBUG   ] spawn_process: at 2018-11-25 19:04:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:04:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:04:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:04:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:04:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:04:56 [WARNING ] (13, 1, 'bot')
2018-11-25 19:04:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:04:56 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-11-25 19:05:07 [DEBUG   ] Got command BAM from MCS: ref #625278
2018-11-25 19:05:07 [INFO    ] Finished processing BAM request
2018-11-25 19:05:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625278   8 58447 68707033 A  ERROR'
2018-11-25 19:05:07 [DEBUG   ] Got command BAM from MCS: ref #625279
2018-11-25 19:05:07 [INFO    ] Finished processing BAM request
2018-11-25 19:05:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625279   8 58447 68707037 A  ERROR'
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:05:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:05:07 [DEBUG   ] spawn_process: at 2018-11-25 19:05:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:05:14 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 19:05:19 [DEBUG   ] Got command BAM from MCS: ref #625280
2018-11-25 19:05:19 [INFO    ] Finished processing BAM request
2018-11-25 19:05:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625280   8 58447 68719033 A  ERROR'
2018-11-25 19:05:19 [DEBUG   ] Got command BAM from MCS: ref #625281
2018-11-25 19:05:19 [INFO    ] Finished processing BAM request
2018-11-25 19:05:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625281   8 58447 68719037 A  ERROR'
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:05:19 [DEBUG   ] spawn_process: at 2018-11-25 19:05:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:05:31 [DEBUG   ] Got command BAM from MCS: ref #625282
2018-11-25 19:05:31 [INFO    ] Finished processing BAM request
2018-11-25 19:05:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625282   8 58447 68731033 A  ERROR'
2018-11-25 19:05:31 [DEBUG   ] Got command BAM from MCS: ref #625283
2018-11-25 19:05:31 [INFO    ] Finished processing BAM request
2018-11-25 19:05:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625283   8 58447 68731037 A  ERROR'
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:05:31 [DEBUG   ] spawn_process: at 2018-11-25 19:05:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:05:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 19:05:43 [DEBUG   ] Got command BAM from MCS: ref #625285
2018-11-25 19:05:43 [INFO    ] Finished processing BAM request
2018-11-25 19:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625285   8 58447 68743029 A  ERROR'
2018-11-25 19:05:43 [DEBUG   ] Got command BAM from MCS: ref #625284
2018-11-25 19:05:43 [INFO    ] Finished processing BAM request
2018-11-25 19:05:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625284   8 58447 68743033 A  ERROR'
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:05:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:05:43 [DEBUG   ] spawn_process: at 2018-11-25 19:05:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:05:48 [DEBUG   ] Got command RPT from MCS: ref #625286
2018-11-25 19:05:48 [DEBUG   ] summary = ERROR
2018-11-25 19:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625286  13 58447 68748469 A  ERRORERROR'
2018-11-25 19:05:48 [DEBUG   ] Got command RPT from MCS: ref #625287
2018-11-25 19:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625287  77 58447 68748470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:05:54 [DEBUG   ] Got command BAM from MCS: ref #625303
2018-11-25 19:05:54 [INFO    ] Finished processing BAM request
2018-11-25 19:05:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625303   8 58447 68754029 A  ERROR'
2018-11-25 19:05:54 [DEBUG   ] Got command BAM from MCS: ref #625304
2018-11-25 19:05:54 [INFO    ] Finished processing BAM request
2018-11-25 19:05:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625304   8 58447 68754033 A  ERROR'
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:05:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:05:54 [DEBUG   ] spawn_process: at 2018-11-25 19:05:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:05:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 19:05:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:05:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:05:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:05:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:05:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:05:57 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-11-25 19:06:05 [DEBUG   ] Got command BAM from MCS: ref #625305
2018-11-25 19:06:05 [INFO    ] Finished processing BAM request
2018-11-25 19:06:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625305   8 58447 68765029 A  ERROR'
2018-11-25 19:06:05 [DEBUG   ] Got command BAM from MCS: ref #625306
2018-11-25 19:06:05 [INFO    ] Finished processing BAM request
2018-11-25 19:06:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625306   8 58447 68765033 A  ERROR'
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:06:05 [DEBUG   ] spawn_process: at 2018-11-25 19:06:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:06:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 19:06:16 [DEBUG   ] Got command BAM from MCS: ref #625307
2018-11-25 19:06:16 [INFO    ] Finished processing BAM request
2018-11-25 19:06:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625307   8 58447 68776033 A  ERROR'
2018-11-25 19:06:16 [DEBUG   ] Got command BAM from MCS: ref #625308
2018-11-25 19:06:16 [INFO    ] Finished processing BAM request
2018-11-25 19:06:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625308   8 58447 68776037 A  ERROR'
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:06:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:06:16 [DEBUG   ] spawn_process: at 2018-11-25 19:06:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:06:27 [DEBUG   ] Got command BAM from MCS: ref #625309
2018-11-25 19:06:27 [INFO    ] Finished processing BAM request
2018-11-25 19:06:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625309   8 58447 68787025 A  ERROR'
2018-11-25 19:06:27 [DEBUG   ] Got command BAM from MCS: ref #625310
2018-11-25 19:06:27 [INFO    ] Finished processing BAM request
2018-11-25 19:06:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625310   8 58447 68787029 A  ERROR'
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:06:27 [DEBUG   ] spawn_process: at 2018-11-25 19:06:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:06:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:06:38 [DEBUG   ] Got command BAM from MCS: ref #625316
2018-11-25 19:06:38 [INFO    ] Finished processing BAM request
2018-11-25 19:06:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625316   8 58447 68798029 A  ERROR'
2018-11-25 19:06:38 [DEBUG   ] Got command BAM from MCS: ref #625315
2018-11-25 19:06:38 [INFO    ] Finished processing BAM request
2018-11-25 19:06:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625315   8 58447 68798033 A  ERROR'
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:06:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:06:38 [DEBUG   ] spawn_process: at 2018-11-25 19:06:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:06:49 [DEBUG   ] Got command BAM from MCS: ref #625318
2018-11-25 19:06:49 [INFO    ] Finished processing BAM request
2018-11-25 19:06:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625318   8 58447 68809033 A  ERROR'
2018-11-25 19:06:49 [DEBUG   ] Got command BAM from MCS: ref #625317
2018-11-25 19:06:49 [INFO    ] Finished processing BAM request
2018-11-25 19:06:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625317   8 58447 68809037 A  ERROR'
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:06:49 [DEBUG   ] spawn_process: at 2018-11-25 19:06:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:06:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:06:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 19:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:06:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 19:06:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:06:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:06:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:06:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:06:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:06:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:06:57 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-11-25 19:07:00 [DEBUG   ] Got command BAM from MCS: ref #625319
2018-11-25 19:07:00 [INFO    ] Finished processing BAM request
2018-11-25 19:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625319   8 58447 68820025 A  ERROR'
2018-11-25 19:07:00 [DEBUG   ] Got command BAM from MCS: ref #625320
2018-11-25 19:07:00 [INFO    ] Finished processing BAM request
2018-11-25 19:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625320   8 58447 68820029 A  ERROR'
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:07:00 [DEBUG   ] spawn_process: at 2018-11-25 19:07:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:07:11 [DEBUG   ] Got command BAM from MCS: ref #625322
2018-11-25 19:07:11 [INFO    ] Finished processing BAM request
2018-11-25 19:07:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625322   8 58447 68831025 A  ERROR'
2018-11-25 19:07:11 [DEBUG   ] Got command BAM from MCS: ref #625321
2018-11-25 19:07:11 [INFO    ] Finished processing BAM request
2018-11-25 19:07:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625321   8 58447 68831029 A  ERROR'
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:07:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:07:11 [DEBUG   ] spawn_process: at 2018-11-25 19:07:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:07:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:07:22 [DEBUG   ] Got command BAM from MCS: ref #625323
2018-11-25 19:07:22 [INFO    ] Finished processing BAM request
2018-11-25 19:07:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625323   8 58447 68842025 A  ERROR'
2018-11-25 19:07:22 [DEBUG   ] Got command BAM from MCS: ref #625324
2018-11-25 19:07:22 [INFO    ] Finished processing BAM request
2018-11-25 19:07:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625324   8 58447 68842029 A  ERROR'
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:07:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:07:22 [DEBUG   ] spawn_process: at 2018-11-25 19:07:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:07:23 [DEBUG   ] Got command RPT from MCS: ref #625325
2018-11-25 19:07:23 [DEBUG   ] summary = ERROR
2018-11-25 19:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625325  13 58447 68843677 A  ERRORERROR'
2018-11-25 19:07:23 [DEBUG   ] Got command RPT from MCS: ref #625326
2018-11-25 19:07:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625326  77 58447 68843881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:07:24 [DEBUG   ] Got command RPT from MCS: ref #625327
2018-11-25 19:07:24 [DEBUG   ] summary = ERROR
2018-11-25 19:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625327  13 58447 68844085 A  ERRORERROR'
2018-11-25 19:07:24 [DEBUG   ] Got command RPT from MCS: ref #625328
2018-11-25 19:07:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625328  77 58447 68844289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:07:24 [DEBUG   ] Got command RPT from MCS: ref #625329
2018-11-25 19:07:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625329  12 58447 68844481 A  ERRORB¢ff'
2018-11-25 19:07:33 [DEBUG   ] Got command BAM from MCS: ref #625331
2018-11-25 19:07:33 [INFO    ] Finished processing BAM request
2018-11-25 19:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625331   8 58447 68853033 A  ERROR'
2018-11-25 19:07:33 [DEBUG   ] Got command BAM from MCS: ref #625330
2018-11-25 19:07:33 [INFO    ] Finished processing BAM request
2018-11-25 19:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625330   8 58447 68853037 A  ERROR'
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:07:33 [DEBUG   ] spawn_process: at 2018-11-25 19:07:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:07:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:07:44 [DEBUG   ] Got command BAM from MCS: ref #625333
2018-11-25 19:07:44 [INFO    ] Finished processing BAM request
2018-11-25 19:07:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625333   8 58447 68864033 A  ERROR'
2018-11-25 19:07:44 [DEBUG   ] Got command BAM from MCS: ref #625332
2018-11-25 19:07:44 [INFO    ] Finished processing BAM request
2018-11-25 19:07:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625332   8 58447 68864037 A  ERROR'
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:07:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:07:44 [DEBUG   ] spawn_process: at 2018-11-25 19:07:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:07:55 [DEBUG   ] Got command BAM from MCS: ref #625335
2018-11-25 19:07:55 [INFO    ] Finished processing BAM request
2018-11-25 19:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625335   8 58447 68875025 A  ERROR'
2018-11-25 19:07:55 [DEBUG   ] Got command BAM from MCS: ref #625334
2018-11-25 19:07:55 [INFO    ] Finished processing BAM request
2018-11-25 19:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625334   8 58447 68875029 A  ERROR'
2018-11-25 19:07:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:07:55 [DEBUG   ] spawn_process: at 2018-11-25 19:07:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:07:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:07:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 19:07:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:07:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:07:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:07:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:07:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:07:57 [DEBUG   ] Finished updating board flags in 1.199 seconds
2018-11-25 19:08:06 [DEBUG   ] Got command BAM from MCS: ref #625337
2018-11-25 19:08:06 [INFO    ] Finished processing BAM request
2018-11-25 19:08:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625337   8 58447 68886029 A  ERROR'
2018-11-25 19:08:06 [DEBUG   ] Got command BAM from MCS: ref #625336
2018-11-25 19:08:06 [INFO    ] Finished processing BAM request
2018-11-25 19:08:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625336   8 58447 68886033 A  ERROR'
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:08:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:08:06 [DEBUG   ] spawn_process: at 2018-11-25 19:08:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:08:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:08:17 [DEBUG   ] Got command BAM from MCS: ref #625339
2018-11-25 19:08:17 [INFO    ] Finished processing BAM request
2018-11-25 19:08:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625339   8 58447 68897029 A  ERROR'
2018-11-25 19:08:17 [DEBUG   ] Got command BAM from MCS: ref #625338
2018-11-25 19:08:17 [INFO    ] Finished processing BAM request
2018-11-25 19:08:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625338   8 58447 68897033 A  ERROR'
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:08:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:08:17 [DEBUG   ] spawn_process: at 2018-11-25 19:08:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:08:28 [DEBUG   ] Got command BAM from MCS: ref #625340
2018-11-25 19:08:28 [INFO    ] Finished processing BAM request
2018-11-25 19:08:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625340   8 58447 68908029 A  ERROR'
2018-11-25 19:08:28 [DEBUG   ] Got command BAM from MCS: ref #625341
2018-11-25 19:08:28 [INFO    ] Finished processing BAM request
2018-11-25 19:08:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625341   8 58447 68908033 A  ERROR'
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:08:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:08:28 [DEBUG   ] spawn_process: at 2018-11-25 19:08:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:08:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:08:39 [DEBUG   ] Got command BAM from MCS: ref #625342
2018-11-25 19:08:39 [INFO    ] Finished processing BAM request
2018-11-25 19:08:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625342   8 58447 68919033 A  ERROR'
2018-11-25 19:08:39 [DEBUG   ] Got command BAM from MCS: ref #625343
2018-11-25 19:08:39 [INFO    ] Finished processing BAM request
2018-11-25 19:08:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625343   8 58447 68919037 A  ERROR'
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:08:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:08:39 [DEBUG   ] spawn_process: at 2018-11-25 19:08:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:08:50 [DEBUG   ] Got command BAM from MCS: ref #625345
2018-11-25 19:08:50 [INFO    ] Finished processing BAM request
2018-11-25 19:08:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625345   8 58447 68930025 A  ERROR'
2018-11-25 19:08:50 [DEBUG   ] Got command BAM from MCS: ref #625344
2018-11-25 19:08:50 [INFO    ] Finished processing BAM request
2018-11-25 19:08:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:08:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625344   8 58447 68930029 A  ERROR'
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:08:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:08:50 [DEBUG   ] spawn_process: at 2018-11-25 19:08:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:08:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:08:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:08:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:08:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:08:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:08:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:08:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:08:57 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-25 19:09:01 [DEBUG   ] Got command BAM from MCS: ref #625347
2018-11-25 19:09:01 [INFO    ] Finished processing BAM request
2018-11-25 19:09:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625347   8 58447 68941029 A  ERROR'
2018-11-25 19:09:01 [DEBUG   ] Got command BAM from MCS: ref #625346
2018-11-25 19:09:01 [INFO    ] Finished processing BAM request
2018-11-25 19:09:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625346   8 58447 68941033 A  ERROR'
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:09:01 [DEBUG   ] spawn_process: at 2018-11-25 19:09:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:09:12 [DEBUG   ] Got command BAM from MCS: ref #625348
2018-11-25 19:09:12 [INFO    ] Finished processing BAM request
2018-11-25 19:09:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625348   8 58447 68952029 A  ERROR'
2018-11-25 19:09:12 [DEBUG   ] Got command BAM from MCS: ref #625349
2018-11-25 19:09:12 [INFO    ] Finished processing BAM request
2018-11-25 19:09:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625349   8 58447 68952033 A  ERROR'
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:09:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:09:12 [DEBUG   ] spawn_process: at 2018-11-25 19:09:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:09:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:09:23 [DEBUG   ] Got command BAM from MCS: ref #625351
2018-11-25 19:09:23 [INFO    ] Finished processing BAM request
2018-11-25 19:09:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625351   8 58447 68963029 A  ERROR'
2018-11-25 19:09:23 [DEBUG   ] Got command BAM from MCS: ref #625350
2018-11-25 19:09:23 [INFO    ] Finished processing BAM request
2018-11-25 19:09:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625350   8 58447 68963033 A  ERROR'
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:09:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:09:23 [DEBUG   ] spawn_process: at 2018-11-25 19:09:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:09:34 [DEBUG   ] Got command BAM from MCS: ref #625352
2018-11-25 19:09:34 [INFO    ] Finished processing BAM request
2018-11-25 19:09:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625352   8 58447 68974033 A  ERROR'
2018-11-25 19:09:34 [DEBUG   ] Got command BAM from MCS: ref #625353
2018-11-25 19:09:34 [INFO    ] Finished processing BAM request
2018-11-25 19:09:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625353   8 58447 68974037 A  ERROR'
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:09:35 [DEBUG   ] spawn_process: at 2018-11-25 19:09:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:09:35 [DEBUG   ] Finished updating ant stats in 1.039 seconds
2018-11-25 19:09:45 [DEBUG   ] Got command BAM from MCS: ref #625358
2018-11-25 19:09:45 [INFO    ] Finished processing BAM request
2018-11-25 19:09:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625358   8 58447 68985029 A  ERROR'
2018-11-25 19:09:45 [DEBUG   ] Got command BAM from MCS: ref #625359
2018-11-25 19:09:45 [INFO    ] Finished processing BAM request
2018-11-25 19:09:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625359   8 58447 68985033 A  ERROR'
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:09:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:09:45 [DEBUG   ] spawn_process: at 2018-11-25 19:09:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:09:55 [DEBUG   ] Finished updating ant stats in 0.967 seconds
2018-11-25 19:09:56 [DEBUG   ] Got command BAM from MCS: ref #625360
2018-11-25 19:09:56 [INFO    ] Finished processing BAM request
2018-11-25 19:09:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625360   8 58447 68996033 A  ERROR'
2018-11-25 19:09:56 [DEBUG   ] Got command BAM from MCS: ref #625361
2018-11-25 19:09:56 [INFO    ] Finished processing BAM request
2018-11-25 19:09:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625361   8 58447 68996037 A  ERROR'
2018-11-25 19:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-25 19:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:09:56 [DEBUG   ] spawn_process: at 2018-11-25 19:09:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-25 19:09:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:09:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:09:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:09:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:09:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:09:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:09:57 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-25 19:10:07 [DEBUG   ] Got command BAM from MCS: ref #625363
2018-11-25 19:10:07 [INFO    ] Finished processing BAM request
2018-11-25 19:10:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625363   8 58447 69007033 A  ERROR'
2018-11-25 19:10:07 [DEBUG   ] Got command BAM from MCS: ref #625362
2018-11-25 19:10:07 [INFO    ] Finished processing BAM request
2018-11-25 19:10:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625362   8 58447 69007037 A  ERROR'
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:10:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:10:07 [DEBUG   ] spawn_process: at 2018-11-25 19:10:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:10:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:10:18 [DEBUG   ] Got command BAM from MCS: ref #625364
2018-11-25 19:10:18 [INFO    ] Finished processing BAM request
2018-11-25 19:10:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625364   8 58447 69018029 A  ERROR'
2018-11-25 19:10:18 [DEBUG   ] Got command BAM from MCS: ref #625365
2018-11-25 19:10:18 [INFO    ] Finished processing BAM request
2018-11-25 19:10:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625365   8 58447 69018033 A  ERROR'
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:10:18 [DEBUG   ] spawn_process: at 2018-11-25 19:10:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:10:29 [DEBUG   ] Got command BAM from MCS: ref #625367
2018-11-25 19:10:29 [INFO    ] Finished processing BAM request
2018-11-25 19:10:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625367   8 58447 69029033 A  ERROR'
2018-11-25 19:10:29 [DEBUG   ] Got command BAM from MCS: ref #625366
2018-11-25 19:10:29 [INFO    ] Finished processing BAM request
2018-11-25 19:10:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625366   8 58447 69029037 A  ERROR'
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:10:29 [DEBUG   ] spawn_process: at 2018-11-25 19:10:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:10:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 19:10:40 [DEBUG   ] Got command BAM from MCS: ref #625369
2018-11-25 19:10:40 [INFO    ] Finished processing BAM request
2018-11-25 19:10:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625369   8 58447 69040033 A  ERROR'
2018-11-25 19:10:40 [DEBUG   ] Got command BAM from MCS: ref #625368
2018-11-25 19:10:40 [INFO    ] Finished processing BAM request
2018-11-25 19:10:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625368   8 58447 69040037 A  ERROR'
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:10:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:10:40 [DEBUG   ] spawn_process: at 2018-11-25 19:10:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:10:48 [DEBUG   ] Got command RPT from MCS: ref #625370
2018-11-25 19:10:48 [DEBUG   ] summary = ERROR
2018-11-25 19:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625370  13 58447 69048473 A  ERRORERROR'
2018-11-25 19:10:48 [DEBUG   ] Got command RPT from MCS: ref #625371
2018-11-25 19:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625371  77 58447 69048474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:10:51 [DEBUG   ] Got command BAM from MCS: ref #625388
2018-11-25 19:10:51 [INFO    ] Finished processing BAM request
2018-11-25 19:10:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625388   8 58447 69051033 A  ERROR'
2018-11-25 19:10:51 [DEBUG   ] Got command BAM from MCS: ref #625387
2018-11-25 19:10:51 [INFO    ] Finished processing BAM request
2018-11-25 19:10:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:10:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625387   8 58447 69051037 A  ERROR'
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:10:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:10:51 [DEBUG   ] spawn_process: at 2018-11-25 19:10:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:10:56 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-11-25 19:10:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:10:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 19:10:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:10:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:10:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:10:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:10:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:10:57 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-11-25 19:11:02 [DEBUG   ] Got command BAM from MCS: ref #625389
2018-11-25 19:11:02 [INFO    ] Finished processing BAM request
2018-11-25 19:11:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625389   8 58447 69062029 A  ERROR'
2018-11-25 19:11:02 [DEBUG   ] Got command BAM from MCS: ref #625390
2018-11-25 19:11:02 [INFO    ] Finished processing BAM request
2018-11-25 19:11:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625390   8 58447 69062033 A  ERROR'
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:11:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:11:02 [DEBUG   ] spawn_process: at 2018-11-25 19:11:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:11:13 [DEBUG   ] Got command BAM from MCS: ref #625392
2018-11-25 19:11:13 [INFO    ] Finished processing BAM request
2018-11-25 19:11:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625392   8 58447 69073033 A  ERROR'
2018-11-25 19:11:13 [DEBUG   ] Got command BAM from MCS: ref #625391
2018-11-25 19:11:13 [INFO    ] Finished processing BAM request
2018-11-25 19:11:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625391   8 58447 69073037 A  ERROR'
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:11:13 [DEBUG   ] spawn_process: at 2018-11-25 19:11:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:11:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 19:11:24 [DEBUG   ] Got command BAM from MCS: ref #625393
2018-11-25 19:11:24 [INFO    ] Finished processing BAM request
2018-11-25 19:11:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625393   8 58447 69084025 A  ERROR'
2018-11-25 19:11:24 [DEBUG   ] Got command BAM from MCS: ref #625394
2018-11-25 19:11:24 [INFO    ] Finished processing BAM request
2018-11-25 19:11:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625394   8 58447 69084029 A  ERROR'
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:11:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:11:24 [DEBUG   ] spawn_process: at 2018-11-25 19:11:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:11:35 [DEBUG   ] Got command BAM from MCS: ref #625395
2018-11-25 19:11:35 [INFO    ] Finished processing BAM request
2018-11-25 19:11:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625395   8 58447 69095029 A  ERROR'
2018-11-25 19:11:35 [DEBUG   ] Got command BAM from MCS: ref #625396
2018-11-25 19:11:35 [INFO    ] Finished processing BAM request
2018-11-25 19:11:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625396   8 58447 69095037 A  ERROR'
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:11:35 [DEBUG   ] spawn_process: at 2018-11-25 19:11:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:11:36 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-25 19:11:46 [DEBUG   ] Got command BAM from MCS: ref #625397
2018-11-25 19:11:46 [INFO    ] Finished processing BAM request
2018-11-25 19:11:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625397   8 58447 69106029 A  ERROR'
2018-11-25 19:11:46 [DEBUG   ] Got command BAM from MCS: ref #625398
2018-11-25 19:11:46 [INFO    ] Finished processing BAM request
2018-11-25 19:11:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625398   8 58447 69106033 A  ERROR'
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:11:46 [DEBUG   ] spawn_process: at 2018-11-25 19:11:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:11:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:11:57 [DEBUG   ] Got command BAM from MCS: ref #625400
2018-11-25 19:11:57 [INFO    ] Finished processing BAM request
2018-11-25 19:11:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625400   8 58447 69117033 A  ERROR'
2018-11-25 19:11:57 [DEBUG   ] Got command BAM from MCS: ref #625399
2018-11-25 19:11:57 [INFO    ] Finished processing BAM request
2018-11-25 19:11:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625399   8 58447 69117037 A  ERROR'
2018-11-25 19:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2018-11-25 19:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 19:11:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-25 19:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:11:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:11:57 [DEBUG   ] spawn_process: at 2018-11-25 19:11:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:11:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:11:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:11:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:11:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:11:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:11:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:11:58 [DEBUG   ] Finished updating board flags in 1.834 seconds
2018-11-25 19:12:07 [DEBUG   ] Got command BAM from MCS: ref #625404
2018-11-25 19:12:07 [INFO    ] Finished processing BAM request
2018-11-25 19:12:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625404   8 58447 69127029 A  ERROR'
2018-11-25 19:12:07 [DEBUG   ] Got command BAM from MCS: ref #625403
2018-11-25 19:12:07 [INFO    ] Finished processing BAM request
2018-11-25 19:12:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625403   8 58447 69127033 A  ERROR'
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:12:07 [DEBUG   ] spawn_process: at 2018-11-25 19:12:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:12:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-25 19:12:17 [DEBUG   ] Got command BAM from MCS: ref #625406
2018-11-25 19:12:17 [INFO    ] Finished processing BAM request
2018-11-25 19:12:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625406   8 58447 69137033 A  ERROR'
2018-11-25 19:12:17 [DEBUG   ] Got command BAM from MCS: ref #625405
2018-11-25 19:12:17 [INFO    ] Finished processing BAM request
2018-11-25 19:12:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625405   8 58447 69137037 A  ERROR'
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:12:17 [DEBUG   ] spawn_process: at 2018-11-25 19:12:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:12:23 [DEBUG   ] Got command RPT from MCS: ref #625407
2018-11-25 19:12:23 [DEBUG   ] summary = ERROR
2018-11-25 19:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625407  13 58447 69143773 A  ERRORERROR'
2018-11-25 19:12:23 [DEBUG   ] Got command RPT from MCS: ref #625408
2018-11-25 19:12:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:12:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625408  77 58447 69143965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:12:24 [DEBUG   ] Got command RPT from MCS: ref #625409
2018-11-25 19:12:24 [DEBUG   ] summary = ERROR
2018-11-25 19:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625409  13 58447 69144169 A  ERRORERROR'
2018-11-25 19:12:24 [DEBUG   ] Got command RPT from MCS: ref #625411
2018-11-25 19:12:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625411  77 58447 69144373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:12:24 [DEBUG   ] Got command RPT from MCS: ref #625412
2018-11-25 19:12:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625412  12 58447 69144565 A  ERRORB£ff'
2018-11-25 19:12:27 [DEBUG   ] Got command BAM from MCS: ref #625417
2018-11-25 19:12:27 [INFO    ] Finished processing BAM request
2018-11-25 19:12:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625417   8 58447 69147029 A  ERROR'
2018-11-25 19:12:27 [DEBUG   ] Got command BAM from MCS: ref #625418
2018-11-25 19:12:27 [INFO    ] Finished processing BAM request
2018-11-25 19:12:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625418   8 58447 69147033 A  ERROR'
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:12:27 [DEBUG   ] spawn_process: at 2018-11-25 19:12:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:12:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:12:37 [DEBUG   ] Got command BAM from MCS: ref #625423
2018-11-25 19:12:37 [INFO    ] Finished processing BAM request
2018-11-25 19:12:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625423   8 58447 69157025 A  ERROR'
2018-11-25 19:12:37 [DEBUG   ] Got command BAM from MCS: ref #625424
2018-11-25 19:12:37 [INFO    ] Finished processing BAM request
2018-11-25 19:12:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625424   8 58447 69157029 A  ERROR'
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:12:37 [DEBUG   ] spawn_process: at 2018-11-25 19:12:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:12:47 [DEBUG   ] Got command BAM from MCS: ref #625426
2018-11-25 19:12:47 [INFO    ] Finished processing BAM request
2018-11-25 19:12:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625426   8 58447 69167033 A  ERROR'
2018-11-25 19:12:47 [DEBUG   ] Got command BAM from MCS: ref #625425
2018-11-25 19:12:47 [INFO    ] Finished processing BAM request
2018-11-25 19:12:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625425   8 58447 69167037 A  ERROR'
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:12:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:12:47 [DEBUG   ] spawn_process: at 2018-11-25 19:12:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:12:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:12:57 [DEBUG   ] Got command BAM from MCS: ref #625428
2018-11-25 19:12:57 [INFO    ] Finished processing BAM request
2018-11-25 19:12:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625428   8 58447 69177025 A  ERROR'
2018-11-25 19:12:57 [DEBUG   ] Got command BAM from MCS: ref #625427
2018-11-25 19:12:57 [INFO    ] Finished processing BAM request
2018-11-25 19:12:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:12:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625427   8 58447 69177029 A  ERROR'
2018-11-25 19:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:12:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:12:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:12:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:12:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:12:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:12:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:12:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:12:57 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:12:57 [DEBUG   ] spawn_process: at 2018-11-25 19:12:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:13:07 [DEBUG   ] Got command BAM from MCS: ref #625429
2018-11-25 19:13:07 [INFO    ] Finished processing BAM request
2018-11-25 19:13:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625429   8 58447 69187029 A  ERROR'
2018-11-25 19:13:07 [DEBUG   ] Got command BAM from MCS: ref #625430
2018-11-25 19:13:07 [INFO    ] Finished processing BAM request
2018-11-25 19:13:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625430   8 58447 69187033 A  ERROR'
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:13:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:13:07 [DEBUG   ] spawn_process: at 2018-11-25 19:13:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:13:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:13:17 [DEBUG   ] Got command BAM from MCS: ref #625432
2018-11-25 19:13:17 [INFO    ] Finished processing BAM request
2018-11-25 19:13:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625432   8 58447 69197033 A  ERROR'
2018-11-25 19:13:17 [DEBUG   ] Got command BAM from MCS: ref #625431
2018-11-25 19:13:17 [INFO    ] Finished processing BAM request
2018-11-25 19:13:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625431   8 58447 69197037 A  ERROR'
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:13:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:13:17 [DEBUG   ] spawn_process: at 2018-11-25 19:13:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:13:27 [DEBUG   ] Got command BAM from MCS: ref #625434
2018-11-25 19:13:27 [INFO    ] Finished processing BAM request
2018-11-25 19:13:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625434   8 58447 69207025 A  ERROR'
2018-11-25 19:13:27 [DEBUG   ] Got command BAM from MCS: ref #625433
2018-11-25 19:13:27 [INFO    ] Finished processing BAM request
2018-11-25 19:13:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625433   8 58447 69207029 A  ERROR'
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:13:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:13:27 [DEBUG   ] spawn_process: at 2018-11-25 19:13:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:13:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:13:37 [DEBUG   ] Got command BAM from MCS: ref #625435
2018-11-25 19:13:37 [INFO    ] Finished processing BAM request
2018-11-25 19:13:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625435   8 58447 69217033 A  ERROR'
2018-11-25 19:13:37 [DEBUG   ] Got command BAM from MCS: ref #625436
2018-11-25 19:13:37 [INFO    ] Finished processing BAM request
2018-11-25 19:13:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625436   8 58447 69217037 A  ERROR'
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:13:37 [DEBUG   ] spawn_process: at 2018-11-25 19:13:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:13:47 [DEBUG   ] Got command BAM from MCS: ref #625437
2018-11-25 19:13:47 [INFO    ] Finished processing BAM request
2018-11-25 19:13:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625437   8 58447 69227025 A  ERROR'
2018-11-25 19:13:47 [DEBUG   ] Got command BAM from MCS: ref #625438
2018-11-25 19:13:47 [INFO    ] Finished processing BAM request
2018-11-25 19:13:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625438   8 58447 69227029 A  ERROR'
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:13:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:13:47 [DEBUG   ] spawn_process: at 2018-11-25 19:13:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:13:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 19:13:57 [DEBUG   ] Got command BAM from MCS: ref #625439
2018-11-25 19:13:57 [INFO    ] Finished processing BAM request
2018-11-25 19:13:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625439   8 58447 69237025 A  ERROR'
2018-11-25 19:13:57 [DEBUG   ] Got command BAM from MCS: ref #625440
2018-11-25 19:13:57 [INFO    ] Finished processing BAM request
2018-11-25 19:13:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625440   8 58447 69237029 A  ERROR'
2018-11-25 19:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 19:13:57 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:13:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:13:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:13:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:13:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:13:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:13:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:13:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:13:57 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:13:57 [DEBUG   ] spawn_process: at 2018-11-25 19:13:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:14:07 [DEBUG   ] Got command BAM from MCS: ref #625442
2018-11-25 19:14:07 [INFO    ] Finished processing BAM request
2018-11-25 19:14:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625442   8 58447 69247025 A  ERROR'
2018-11-25 19:14:07 [DEBUG   ] Got command BAM from MCS: ref #625441
2018-11-25 19:14:07 [INFO    ] Finished processing BAM request
2018-11-25 19:14:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625441   8 58447 69247029 A  ERROR'
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:14:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:14:07 [DEBUG   ] spawn_process: at 2018-11-25 19:14:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:14:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 19:14:17 [DEBUG   ] Got command BAM from MCS: ref #625444
2018-11-25 19:14:17 [INFO    ] Finished processing BAM request
2018-11-25 19:14:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625444   8 58447 69257025 A  ERROR'
2018-11-25 19:14:17 [DEBUG   ] Got command BAM from MCS: ref #625443
2018-11-25 19:14:17 [INFO    ] Finished processing BAM request
2018-11-25 19:14:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625443   8 58447 69257029 A  ERROR'
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:14:17 [DEBUG   ] spawn_process: at 2018-11-25 19:14:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:14:27 [DEBUG   ] Got command BAM from MCS: ref #625445
2018-11-25 19:14:27 [INFO    ] Finished processing BAM request
2018-11-25 19:14:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625445   8 58447 69267029 A  ERROR'
2018-11-25 19:14:27 [DEBUG   ] Got command BAM from MCS: ref #625446
2018-11-25 19:14:27 [INFO    ] Finished processing BAM request
2018-11-25 19:14:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625446   8 58447 69267033 A  ERROR'
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:14:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:14:27 [DEBUG   ] spawn_process: at 2018-11-25 19:14:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:14:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:14:37 [DEBUG   ] Got command BAM from MCS: ref #625447
2018-11-25 19:14:37 [INFO    ] Finished processing BAM request
2018-11-25 19:14:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625447   8 58447 69277025 A  ERROR'
2018-11-25 19:14:37 [DEBUG   ] Got command BAM from MCS: ref #625448
2018-11-25 19:14:37 [INFO    ] Finished processing BAM request
2018-11-25 19:14:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625448   8 58447 69277029 A  ERROR'
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:14:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:14:37 [DEBUG   ] spawn_process: at 2018-11-25 19:14:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:14:47 [DEBUG   ] Got command BAM from MCS: ref #625449
2018-11-25 19:14:47 [INFO    ] Finished processing BAM request
2018-11-25 19:14:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625449   8 58447 69287029 A  ERROR'
2018-11-25 19:14:47 [DEBUG   ] Got command BAM from MCS: ref #625450
2018-11-25 19:14:47 [INFO    ] Finished processing BAM request
2018-11-25 19:14:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625450   8 58447 69287033 A  ERROR'
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:14:47 [DEBUG   ] spawn_process: at 2018-11-25 19:14:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:14:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 19:14:57 [DEBUG   ] Got command BAM from MCS: ref #625452
2018-11-25 19:14:57 [INFO    ] Finished processing BAM request
2018-11-25 19:14:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625452   8 58447 69297029 A  ERROR'
2018-11-25 19:14:57 [DEBUG   ] Got command BAM from MCS: ref #625451
2018-11-25 19:14:57 [INFO    ] Finished processing BAM request
2018-11-25 19:14:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625451   8 58447 69297033 A  ERROR'
2018-11-25 19:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 19:14:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-25 19:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 19:14:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:14:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:14:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:14:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:14:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:14:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:14:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:14:57 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:14:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:14:57 [DEBUG   ] spawn_process: at 2018-11-25 19:14:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:15:07 [DEBUG   ] Got command BAM from MCS: ref #625454
2018-11-25 19:15:07 [INFO    ] Finished processing BAM request
2018-11-25 19:15:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625454   8 58447 69307025 A  ERROR'
2018-11-25 19:15:07 [DEBUG   ] Got command BAM from MCS: ref #625453
2018-11-25 19:15:07 [INFO    ] Finished processing BAM request
2018-11-25 19:15:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625453   8 58447 69307029 A  ERROR'
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:15:07 [DEBUG   ] spawn_process: at 2018-11-25 19:15:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:15:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:15:17 [DEBUG   ] Got command BAM from MCS: ref #625456
2018-11-25 19:15:17 [INFO    ] Finished processing BAM request
2018-11-25 19:15:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625456   8 58447 69317029 A  ERROR'
2018-11-25 19:15:17 [DEBUG   ] Got command BAM from MCS: ref #625455
2018-11-25 19:15:17 [INFO    ] Finished processing BAM request
2018-11-25 19:15:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625455   8 58447 69317033 A  ERROR'
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:15:17 [DEBUG   ] spawn_process: at 2018-11-25 19:15:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:15:27 [DEBUG   ] Got command BAM from MCS: ref #625457
2018-11-25 19:15:27 [INFO    ] Finished processing BAM request
2018-11-25 19:15:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625457   8 58447 69327033 A  ERROR'
2018-11-25 19:15:27 [DEBUG   ] Got command BAM from MCS: ref #625458
2018-11-25 19:15:27 [INFO    ] Finished processing BAM request
2018-11-25 19:15:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625458   8 58447 69327037 A  ERROR'
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:15:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:15:27 [DEBUG   ] spawn_process: at 2018-11-25 19:15:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:15:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:15:37 [DEBUG   ] Got command BAM from MCS: ref #625463
2018-11-25 19:15:37 [INFO    ] Finished processing BAM request
2018-11-25 19:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625463   8 58447 69337025 A  ERROR'
2018-11-25 19:15:37 [DEBUG   ] Got command BAM from MCS: ref #625464
2018-11-25 19:15:37 [INFO    ] Finished processing BAM request
2018-11-25 19:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625464   8 58447 69337029 A  ERROR'
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:15:37 [DEBUG   ] spawn_process: at 2018-11-25 19:15:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:15:47 [DEBUG   ] Got command BAM from MCS: ref #625466
2018-11-25 19:15:47 [INFO    ] Finished processing BAM request
2018-11-25 19:15:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625466   8 58447 69347029 A  ERROR'
2018-11-25 19:15:47 [DEBUG   ] Got command BAM from MCS: ref #625465
2018-11-25 19:15:47 [INFO    ] Finished processing BAM request
2018-11-25 19:15:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625465   8 58447 69347033 A  ERROR'
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:15:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:15:47 [DEBUG   ] spawn_process: at 2018-11-25 19:15:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:15:48 [DEBUG   ] Got command RPT from MCS: ref #625467
2018-11-25 19:15:48 [DEBUG   ] summary = ERROR
2018-11-25 19:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625467  13 58447 69348473 A  ERRORERROR'
2018-11-25 19:15:48 [DEBUG   ] Got command RPT from MCS: ref #625468
2018-11-25 19:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625468  77 58447 69348474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:15:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:15:57 [DEBUG   ] Got command BAM from MCS: ref #625485
2018-11-25 19:15:57 [INFO    ] Finished processing BAM request
2018-11-25 19:15:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625485   8 58447 69357025 A  ERROR'
2018-11-25 19:15:57 [DEBUG   ] Got command BAM from MCS: ref #625484
2018-11-25 19:15:57 [INFO    ] Finished processing BAM request
2018-11-25 19:15:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625484   8 58447 69357029 A  ERROR'
2018-11-25 19:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:15:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:15:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:15:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:15:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:15:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:15:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:15:57 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:15:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:15:57 [DEBUG   ] spawn_process: at 2018-11-25 19:15:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:16:07 [DEBUG   ] Got command BAM from MCS: ref #625486
2018-11-25 19:16:07 [INFO    ] Finished processing BAM request
2018-11-25 19:16:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625486   8 58447 69367033 A  ERROR'
2018-11-25 19:16:07 [DEBUG   ] Got command BAM from MCS: ref #625487
2018-11-25 19:16:07 [INFO    ] Finished processing BAM request
2018-11-25 19:16:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625487   8 58447 69367037 A  ERROR'
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:16:07 [DEBUG   ] spawn_process: at 2018-11-25 19:16:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:16:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:16:17 [DEBUG   ] Got command BAM from MCS: ref #625488
2018-11-25 19:16:17 [INFO    ] Finished processing BAM request
2018-11-25 19:16:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625488   8 58447 69377030 A  ERROR'
2018-11-25 19:16:17 [DEBUG   ] Got command BAM from MCS: ref #625489
2018-11-25 19:16:17 [INFO    ] Finished processing BAM request
2018-11-25 19:16:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625489   8 58447 69377034 A  ERROR'
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:16:17 [DEBUG   ] spawn_process: at 2018-11-25 19:16:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:16:27 [DEBUG   ] Got command BAM from MCS: ref #625491
2018-11-25 19:16:27 [INFO    ] Finished processing BAM request
2018-11-25 19:16:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625491   8 58447 69387034 A  ERROR'
2018-11-25 19:16:27 [DEBUG   ] Got command BAM from MCS: ref #625490
2018-11-25 19:16:27 [INFO    ] Finished processing BAM request
2018-11-25 19:16:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625490   8 58447 69387038 A  ERROR'
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:16:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:16:27 [DEBUG   ] spawn_process: at 2018-11-25 19:16:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:16:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:16:37 [DEBUG   ] Got command BAM from MCS: ref #625493
2018-11-25 19:16:37 [INFO    ] Finished processing BAM request
2018-11-25 19:16:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625493   8 58447 69397026 A  ERROR'
2018-11-25 19:16:37 [DEBUG   ] Got command BAM from MCS: ref #625492
2018-11-25 19:16:37 [INFO    ] Finished processing BAM request
2018-11-25 19:16:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625492   8 58447 69397030 A  ERROR'
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:16:37 [DEBUG   ] spawn_process: at 2018-11-25 19:16:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:16:47 [DEBUG   ] Got command BAM from MCS: ref #625494
2018-11-25 19:16:47 [INFO    ] Finished processing BAM request
2018-11-25 19:16:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625494   8 58447 69407030 A  ERROR'
2018-11-25 19:16:47 [DEBUG   ] Got command BAM from MCS: ref #625495
2018-11-25 19:16:47 [INFO    ] Finished processing BAM request
2018-11-25 19:16:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625495   8 58447 69407034 A  ERROR'
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:16:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:16:47 [DEBUG   ] spawn_process: at 2018-11-25 19:16:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:16:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:16:57 [DEBUG   ] Got command BAM from MCS: ref #625496
2018-11-25 19:16:57 [INFO    ] Finished processing BAM request
2018-11-25 19:16:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625496   8 58447 69417033 A  ERROR'
2018-11-25 19:16:57 [DEBUG   ] Got command BAM from MCS: ref #625497
2018-11-25 19:16:57 [INFO    ] Finished processing BAM request
2018-11-25 19:16:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625497   8 58447 69417037 A  ERROR'
2018-11-25 19:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-25 19:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 19:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 19:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:16:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:16:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:16:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:16:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:16:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:16:57 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:16:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:16:57 [DEBUG   ] spawn_process: at 2018-11-25 19:16:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:17:07 [DEBUG   ] Got command BAM from MCS: ref #625498
2018-11-25 19:17:07 [INFO    ] Finished processing BAM request
2018-11-25 19:17:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625498   8 58447 69427033 A  ERROR'
2018-11-25 19:17:07 [DEBUG   ] Got command BAM from MCS: ref #625499
2018-11-25 19:17:07 [INFO    ] Finished processing BAM request
2018-11-25 19:17:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625499   8 58447 69427037 A  ERROR'
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:17:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:17:07 [DEBUG   ] spawn_process: at 2018-11-25 19:17:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:17:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 19:17:17 [DEBUG   ] Got command BAM from MCS: ref #625500
2018-11-25 19:17:17 [INFO    ] Finished processing BAM request
2018-11-25 19:17:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625500   8 58447 69437029 A  ERROR'
2018-11-25 19:17:17 [DEBUG   ] Got command BAM from MCS: ref #625501
2018-11-25 19:17:17 [INFO    ] Finished processing BAM request
2018-11-25 19:17:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625501   8 58447 69437033 A  ERROR'
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:17:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:17:17 [DEBUG   ] spawn_process: at 2018-11-25 19:17:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:17:23 [DEBUG   ] Got command RPT from MCS: ref #625502
2018-11-25 19:17:23 [DEBUG   ] summary = ERROR
2018-11-25 19:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625502  13 58447 69443850 A  ERRORERROR'
2018-11-25 19:17:24 [DEBUG   ] Got command RPT from MCS: ref #625503
2018-11-25 19:17:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625503  77 58447 69444053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:17:24 [DEBUG   ] Got command RPT from MCS: ref #625504
2018-11-25 19:17:24 [DEBUG   ] summary = ERROR
2018-11-25 19:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625504  13 58447 69444257 A  ERRORERROR'
2018-11-25 19:17:24 [DEBUG   ] Got command RPT from MCS: ref #625505
2018-11-25 19:17:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625505  77 58447 69444461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:17:24 [DEBUG   ] Got command RPT from MCS: ref #625506
2018-11-25 19:17:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625506  12 58447 69444653 A  ERRORB£ff'
2018-11-25 19:17:27 [DEBUG   ] Got command BAM from MCS: ref #625507
2018-11-25 19:17:27 [INFO    ] Finished processing BAM request
2018-11-25 19:17:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625507   8 58447 69447033 A  ERROR'
2018-11-25 19:17:27 [DEBUG   ] Got command BAM from MCS: ref #625508
2018-11-25 19:17:27 [INFO    ] Finished processing BAM request
2018-11-25 19:17:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625508   8 58447 69447037 A  ERROR'
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:17:27 [DEBUG   ] spawn_process: at 2018-11-25 19:17:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:17:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:17:37 [DEBUG   ] Got command BAM from MCS: ref #625509
2018-11-25 19:17:37 [INFO    ] Finished processing BAM request
2018-11-25 19:17:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625509   8 58447 69457029 A  ERROR'
2018-11-25 19:17:37 [DEBUG   ] Got command BAM from MCS: ref #625510
2018-11-25 19:17:37 [INFO    ] Finished processing BAM request
2018-11-25 19:17:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625510   8 58447 69457033 A  ERROR'
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:17:37 [DEBUG   ] spawn_process: at 2018-11-25 19:17:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:17:47 [DEBUG   ] Got command BAM from MCS: ref #625512
2018-11-25 19:17:47 [INFO    ] Finished processing BAM request
2018-11-25 19:17:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625512   8 58447 69467033 A  ERROR'
2018-11-25 19:17:47 [DEBUG   ] Got command BAM from MCS: ref #625511
2018-11-25 19:17:47 [INFO    ] Finished processing BAM request
2018-11-25 19:17:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625511   8 58447 69467037 A  ERROR'
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:17:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:17:47 [DEBUG   ] spawn_process: at 2018-11-25 19:17:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:17:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 19:17:57 [DEBUG   ] Got command BAM from MCS: ref #625514
2018-11-25 19:17:57 [INFO    ] Finished processing BAM request
2018-11-25 19:17:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625514   8 58447 69477029 A  ERROR'
2018-11-25 19:17:57 [DEBUG   ] Got command BAM from MCS: ref #625513
2018-11-25 19:17:57 [INFO    ] Finished processing BAM request
2018-11-25 19:17:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:17:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625513   8 58447 69477033 A  ERROR'
2018-11-25 19:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:17:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:17:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:17:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:17:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:17:57 [WARNING ] (13, 1, 'bot')
2018-11-25 19:17:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:17:57 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:17:57 [DEBUG   ] spawn_process: at 2018-11-25 19:17:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:18:07 [DEBUG   ] Got command BAM from MCS: ref #625516
2018-11-25 19:18:07 [INFO    ] Finished processing BAM request
2018-11-25 19:18:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625516   8 58447 69487029 A  ERROR'
2018-11-25 19:18:07 [DEBUG   ] Got command BAM from MCS: ref #625515
2018-11-25 19:18:07 [INFO    ] Finished processing BAM request
2018-11-25 19:18:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625515   8 58447 69487033 A  ERROR'
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:18:07 [DEBUG   ] spawn_process: at 2018-11-25 19:18:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:18:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:18:17 [DEBUG   ] Got command BAM from MCS: ref #625518
2018-11-25 19:18:17 [INFO    ] Finished processing BAM request
2018-11-25 19:18:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625518   8 58447 69497029 A  ERROR'
2018-11-25 19:18:17 [DEBUG   ] Got command BAM from MCS: ref #625517
2018-11-25 19:18:17 [INFO    ] Finished processing BAM request
2018-11-25 19:18:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625517   8 58447 69497033 A  ERROR'
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:18:17 [DEBUG   ] spawn_process: at 2018-11-25 19:18:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:18:27 [DEBUG   ] Got command BAM from MCS: ref #625519
2018-11-25 19:18:27 [INFO    ] Finished processing BAM request
2018-11-25 19:18:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625519   8 58447 69507029 A  ERROR'
2018-11-25 19:18:27 [DEBUG   ] Got command BAM from MCS: ref #625520
2018-11-25 19:18:27 [INFO    ] Finished processing BAM request
2018-11-25 19:18:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625520   8 58447 69507033 A  ERROR'
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:18:27 [DEBUG   ] spawn_process: at 2018-11-25 19:18:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:18:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:18:37 [DEBUG   ] Got command BAM from MCS: ref #625526
2018-11-25 19:18:37 [INFO    ] Finished processing BAM request
2018-11-25 19:18:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625526   8 58447 69517025 A  ERROR'
2018-11-25 19:18:37 [DEBUG   ] Got command BAM from MCS: ref #625525
2018-11-25 19:18:37 [INFO    ] Finished processing BAM request
2018-11-25 19:18:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625525   8 58447 69517029 A  ERROR'
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:18:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:18:37 [DEBUG   ] spawn_process: at 2018-11-25 19:18:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:18:47 [DEBUG   ] Got command BAM from MCS: ref #625528
2018-11-25 19:18:47 [INFO    ] Finished processing BAM request
2018-11-25 19:18:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625528   8 58447 69527033 A  ERROR'
2018-11-25 19:18:47 [DEBUG   ] Got command BAM from MCS: ref #625527
2018-11-25 19:18:47 [INFO    ] Finished processing BAM request
2018-11-25 19:18:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625527   8 58447 69527037 A  ERROR'
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:18:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:18:47 [DEBUG   ] spawn_process: at 2018-11-25 19:18:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:18:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:18:57 [DEBUG   ] Got command BAM from MCS: ref #625529
2018-11-25 19:18:57 [INFO    ] Finished processing BAM request
2018-11-25 19:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625529   8 58447 69537029 A  ERROR'
2018-11-25 19:18:57 [DEBUG   ] Got command BAM from MCS: ref #625530
2018-11-25 19:18:57 [INFO    ] Finished processing BAM request
2018-11-25 19:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625530   8 58447 69537033 A  ERROR'
2018-11-25 19:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 19:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:18:57 [DEBUG   ] spawn_process: at 2018-11-25 19:18:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:18:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:18:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:18:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:18:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:18:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:18:58 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-11-25 19:19:07 [DEBUG   ] Got command BAM from MCS: ref #625531
2018-11-25 19:19:07 [INFO    ] Finished processing BAM request
2018-11-25 19:19:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625531   8 58447 69547025 A  ERROR'
2018-11-25 19:19:07 [DEBUG   ] Got command BAM from MCS: ref #625532
2018-11-25 19:19:07 [INFO    ] Finished processing BAM request
2018-11-25 19:19:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625532   8 58447 69547029 A  ERROR'
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:19:07 [DEBUG   ] spawn_process: at 2018-11-25 19:19:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:19:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:19:17 [DEBUG   ] Got command BAM from MCS: ref #625534
2018-11-25 19:19:17 [INFO    ] Finished processing BAM request
2018-11-25 19:19:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625534   8 58447 69557029 A  ERROR'
2018-11-25 19:19:17 [DEBUG   ] Got command BAM from MCS: ref #625533
2018-11-25 19:19:17 [INFO    ] Finished processing BAM request
2018-11-25 19:19:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625533   8 58447 69557033 A  ERROR'
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:19:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:19:17 [DEBUG   ] spawn_process: at 2018-11-25 19:19:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:19:27 [DEBUG   ] Got command BAM from MCS: ref #625535
2018-11-25 19:19:27 [INFO    ] Finished processing BAM request
2018-11-25 19:19:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625535   8 58447 69567033 A  ERROR'
2018-11-25 19:19:27 [DEBUG   ] Got command BAM from MCS: ref #625536
2018-11-25 19:19:27 [INFO    ] Finished processing BAM request
2018-11-25 19:19:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625536   8 58447 69567037 A  ERROR'
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:19:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:19:27 [DEBUG   ] spawn_process: at 2018-11-25 19:19:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:19:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:19:37 [DEBUG   ] Got command BAM from MCS: ref #625538
2018-11-25 19:19:37 [INFO    ] Finished processing BAM request
2018-11-25 19:19:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625538   8 58447 69577034 A  ERROR'
2018-11-25 19:19:37 [DEBUG   ] Got command BAM from MCS: ref #625537
2018-11-25 19:19:37 [INFO    ] Finished processing BAM request
2018-11-25 19:19:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625537   8 58447 69577038 A  ERROR'
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:19:37 [DEBUG   ] spawn_process: at 2018-11-25 19:19:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:19:47 [DEBUG   ] Got command BAM from MCS: ref #625540
2018-11-25 19:19:47 [INFO    ] Finished processing BAM request
2018-11-25 19:19:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625540   8 58447 69587033 A  ERROR'
2018-11-25 19:19:47 [DEBUG   ] Got command BAM from MCS: ref #625539
2018-11-25 19:19:47 [INFO    ] Finished processing BAM request
2018-11-25 19:19:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625539   8 58447 69587041 A  ERROR'
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:19:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:19:47 [DEBUG   ] spawn_process: at 2018-11-25 19:19:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:19:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:19:57 [DEBUG   ] Got command BAM from MCS: ref #625542
2018-11-25 19:19:57 [INFO    ] Finished processing BAM request
2018-11-25 19:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625542   8 58447 69597029 A  ERROR'
2018-11-25 19:19:57 [DEBUG   ] Got command BAM from MCS: ref #625541
2018-11-25 19:19:57 [INFO    ] Finished processing BAM request
2018-11-25 19:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625541   8 58447 69597033 A  ERROR'
2018-11-25 19:19:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 19:19:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:19:57 [DEBUG   ] spawn_process: at 2018-11-25 19:19:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:19:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:19:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:19:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:19:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:19:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:19:58 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-25 19:20:07 [DEBUG   ] Got command BAM from MCS: ref #625544
2018-11-25 19:20:07 [INFO    ] Finished processing BAM request
2018-11-25 19:20:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625544   8 58447 69607025 A  ERROR'
2018-11-25 19:20:07 [DEBUG   ] Got command BAM from MCS: ref #625543
2018-11-25 19:20:07 [INFO    ] Finished processing BAM request
2018-11-25 19:20:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625543   8 58447 69607029 A  ERROR'
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:20:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:20:07 [DEBUG   ] spawn_process: at 2018-11-25 19:20:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:20:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:20:17 [DEBUG   ] Got command BAM from MCS: ref #625546
2018-11-25 19:20:17 [INFO    ] Finished processing BAM request
2018-11-25 19:20:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625546   8 58447 69617033 A  ERROR'
2018-11-25 19:20:17 [DEBUG   ] Got command BAM from MCS: ref #625545
2018-11-25 19:20:17 [INFO    ] Finished processing BAM request
2018-11-25 19:20:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625545   8 58447 69617037 A  ERROR'
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:20:17 [DEBUG   ] spawn_process: at 2018-11-25 19:20:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:20:27 [DEBUG   ] Got command BAM from MCS: ref #625547
2018-11-25 19:20:27 [INFO    ] Finished processing BAM request
2018-11-25 19:20:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625547   8 58447 69627029 A  ERROR'
2018-11-25 19:20:27 [DEBUG   ] Got command BAM from MCS: ref #625548
2018-11-25 19:20:27 [INFO    ] Finished processing BAM request
2018-11-25 19:20:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625548   8 58447 69627033 A  ERROR'
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:20:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:20:27 [DEBUG   ] spawn_process: at 2018-11-25 19:20:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:20:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 19:20:37 [DEBUG   ] Got command BAM from MCS: ref #625550
2018-11-25 19:20:37 [INFO    ] Finished processing BAM request
2018-11-25 19:20:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625550   8 58447 69637033 A  ERROR'
2018-11-25 19:20:37 [DEBUG   ] Got command BAM from MCS: ref #625549
2018-11-25 19:20:37 [INFO    ] Finished processing BAM request
2018-11-25 19:20:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625549   8 58447 69637037 A  ERROR'
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:20:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:20:37 [DEBUG   ] spawn_process: at 2018-11-25 19:20:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:20:47 [DEBUG   ] Got command BAM from MCS: ref #625552
2018-11-25 19:20:47 [INFO    ] Finished processing BAM request
2018-11-25 19:20:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625552   8 58447 69647025 A  ERROR'
2018-11-25 19:20:47 [DEBUG   ] Got command BAM from MCS: ref #625551
2018-11-25 19:20:47 [INFO    ] Finished processing BAM request
2018-11-25 19:20:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625551   8 58447 69647029 A  ERROR'
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:20:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:20:47 [DEBUG   ] spawn_process: at 2018-11-25 19:20:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:20:48 [DEBUG   ] Got command RPT from MCS: ref #625553
2018-11-25 19:20:48 [DEBUG   ] summary = ERROR
2018-11-25 19:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625553  13 58447 69648469 A  ERRORERROR'
2018-11-25 19:20:48 [DEBUG   ] Got command RPT from MCS: ref #625554
2018-11-25 19:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625554  77 58447 69648470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:20:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 19:20:57 [DEBUG   ] Got command BAM from MCS: ref #625571
2018-11-25 19:20:57 [INFO    ] Finished processing BAM request
2018-11-25 19:20:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625571   8 58447 69657029 A  ERROR'
2018-11-25 19:20:57 [DEBUG   ] Got command BAM from MCS: ref #625570
2018-11-25 19:20:57 [INFO    ] Finished processing BAM request
2018-11-25 19:20:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625570   8 58447 69657033 A  ERROR'
2018-11-25 19:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:20:57 [DEBUG   ] spawn_process: at 2018-11-25 19:20:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:20:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:20:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:20:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:20:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:20:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:20:58 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-25 19:21:07 [DEBUG   ] Got command BAM from MCS: ref #625572
2018-11-25 19:21:07 [INFO    ] Finished processing BAM request
2018-11-25 19:21:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625572   8 58447 69667029 A  ERROR'
2018-11-25 19:21:07 [DEBUG   ] Got command BAM from MCS: ref #625573
2018-11-25 19:21:07 [INFO    ] Finished processing BAM request
2018-11-25 19:21:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625573   8 58447 69667033 A  ERROR'
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:21:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:21:07 [DEBUG   ] spawn_process: at 2018-11-25 19:21:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:21:16 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-25 19:21:17 [DEBUG   ] Got command BAM from MCS: ref #625575
2018-11-25 19:21:17 [INFO    ] Finished processing BAM request
2018-11-25 19:21:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625575   8 58447 69677033 A  ERROR'
2018-11-25 19:21:17 [DEBUG   ] Got command BAM from MCS: ref #625574
2018-11-25 19:21:17 [INFO    ] Finished processing BAM request
2018-11-25 19:21:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625574   8 58447 69677037 A  ERROR'
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:21:17 [DEBUG   ] spawn_process: at 2018-11-25 19:21:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:21:27 [DEBUG   ] Got command BAM from MCS: ref #625576
2018-11-25 19:21:27 [INFO    ] Finished processing BAM request
2018-11-25 19:21:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625576   8 58447 69687025 A  ERROR'
2018-11-25 19:21:27 [DEBUG   ] Got command BAM from MCS: ref #625577
2018-11-25 19:21:27 [INFO    ] Finished processing BAM request
2018-11-25 19:21:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625577   8 58447 69687029 A  ERROR'
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:21:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:21:27 [DEBUG   ] spawn_process: at 2018-11-25 19:21:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:21:37 [DEBUG   ] Got command BAM from MCS: ref #625582
2018-11-25 19:21:37 [INFO    ] Finished processing BAM request
2018-11-25 19:21:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625582   8 58447 69697025 A  ERROR'
2018-11-25 19:21:37 [DEBUG   ] Got command BAM from MCS: ref #625583
2018-11-25 19:21:37 [INFO    ] Finished processing BAM request
2018-11-25 19:21:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625583   8 58447 69697029 A  ERROR'
2018-11-25 19:21:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:21:37 [DEBUG   ] spawn_process: at 2018-11-25 19:21:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:21:47 [DEBUG   ] Got command BAM from MCS: ref #625585
2018-11-25 19:21:47 [INFO    ] Finished processing BAM request
2018-11-25 19:21:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625585   8 58447 69707025 A  ERROR'
2018-11-25 19:21:47 [DEBUG   ] Got command BAM from MCS: ref #625584
2018-11-25 19:21:47 [INFO    ] Finished processing BAM request
2018-11-25 19:21:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625584   8 58447 69707029 A  ERROR'
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:21:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:21:47 [DEBUG   ] spawn_process: at 2018-11-25 19:21:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:21:57 [DEBUG   ] Got command BAM from MCS: ref #625586
2018-11-25 19:21:57 [INFO    ] Finished processing BAM request
2018-11-25 19:21:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625586   8 58447 69717033 A  ERROR'
2018-11-25 19:21:57 [DEBUG   ] Got command BAM from MCS: ref #625587
2018-11-25 19:21:57 [INFO    ] Finished processing BAM request
2018-11-25 19:21:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625587   8 58447 69717037 A  ERROR'
2018-11-25 19:21:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:21:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:21:57 [DEBUG   ] spawn_process: at 2018-11-25 19:21:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:21:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:21:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:21:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:21:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:21:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:21:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:21:58 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-11-25 19:22:07 [DEBUG   ] Got command BAM from MCS: ref #625590
2018-11-25 19:22:07 [INFO    ] Finished processing BAM request
2018-11-25 19:22:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625590   8 58447 69727029 A  ERROR'
2018-11-25 19:22:07 [DEBUG   ] Got command BAM from MCS: ref #625591
2018-11-25 19:22:07 [INFO    ] Finished processing BAM request
2018-11-25 19:22:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625591   8 58447 69727033 A  ERROR'
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:22:07 [DEBUG   ] spawn_process: at 2018-11-25 19:22:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:22:17 [DEBUG   ] Got command BAM from MCS: ref #625592
2018-11-25 19:22:17 [INFO    ] Finished processing BAM request
2018-11-25 19:22:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625592   8 58447 69737025 A  ERROR'
2018-11-25 19:22:17 [DEBUG   ] Got command BAM from MCS: ref #625593
2018-11-25 19:22:17 [INFO    ] Finished processing BAM request
2018-11-25 19:22:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625593   8 58447 69737029 A  ERROR'
2018-11-25 19:22:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:22:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:22:17 [DEBUG   ] spawn_process: at 2018-11-25 19:22:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:22:23 [DEBUG   ] Got command RPT from MCS: ref #625594
2018-11-25 19:22:23 [DEBUG   ] summary = ERROR
2018-11-25 19:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625594  13 58447 69743941 A  ERRORERROR'
2018-11-25 19:22:24 [DEBUG   ] Got command RPT from MCS: ref #625595
2018-11-25 19:22:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625595  77 58447 69744133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:22:24 [DEBUG   ] Got command RPT from MCS: ref #625596
2018-11-25 19:22:24 [DEBUG   ] summary = ERROR
2018-11-25 19:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625596  13 58447 69744337 A  ERRORERROR'
2018-11-25 19:22:24 [DEBUG   ] Got command RPT from MCS: ref #625598
2018-11-25 19:22:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625598  77 58447 69744541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:22:24 [DEBUG   ] Got command RPT from MCS: ref #625599
2018-11-25 19:22:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625599  12 58447 69744745 A  ERRORB£ff'
2018-11-25 19:22:27 [DEBUG   ] Got command BAM from MCS: ref #625605
2018-11-25 19:22:27 [INFO    ] Finished processing BAM request
2018-11-25 19:22:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625605   8 58447 69747029 A  ERROR'
2018-11-25 19:22:27 [DEBUG   ] Got command BAM from MCS: ref #625604
2018-11-25 19:22:27 [INFO    ] Finished processing BAM request
2018-11-25 19:22:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625604   8 58447 69747033 A  ERROR'
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:22:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:22:27 [DEBUG   ] spawn_process: at 2018-11-25 19:22:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:22:37 [DEBUG   ] Got command BAM from MCS: ref #625606
2018-11-25 19:22:37 [INFO    ] Finished processing BAM request
2018-11-25 19:22:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625606   8 58447 69757037 A  ERROR'
2018-11-25 19:22:37 [DEBUG   ] Got command BAM from MCS: ref #625607
2018-11-25 19:22:37 [INFO    ] Finished processing BAM request
2018-11-25 19:22:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625607   8 58447 69757045 A  ERROR'
2018-11-25 19:22:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:22:37 [DEBUG   ] spawn_process: at 2018-11-25 19:22:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:22:47 [DEBUG   ] Got command BAM from MCS: ref #625608
2018-11-25 19:22:47 [INFO    ] Finished processing BAM request
2018-11-25 19:22:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625608   8 58447 69767025 A  ERROR'
2018-11-25 19:22:47 [DEBUG   ] Got command BAM from MCS: ref #625609
2018-11-25 19:22:47 [INFO    ] Finished processing BAM request
2018-11-25 19:22:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625609   8 58447 69767029 A  ERROR'
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:22:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:22:47 [DEBUG   ] spawn_process: at 2018-11-25 19:22:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:22:57 [DEBUG   ] Got command BAM from MCS: ref #625610
2018-11-25 19:22:57 [INFO    ] Finished processing BAM request
2018-11-25 19:22:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625610   8 58447 69777037 A  ERROR'
2018-11-25 19:22:57 [DEBUG   ] Got command BAM from MCS: ref #625611
2018-11-25 19:22:57 [INFO    ] Finished processing BAM request
2018-11-25 19:22:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:22:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625611   8 58447 69777045 A  ERROR'
2018-11-25 19:22:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 19:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:22:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:22:57 [DEBUG   ] spawn_process: at 2018-11-25 19:22:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:22:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:22:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:22:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:22:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:22:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:22:58 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-25 19:23:07 [DEBUG   ] Got command BAM from MCS: ref #625612
2018-11-25 19:23:07 [INFO    ] Finished processing BAM request
2018-11-25 19:23:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625612   8 58447 69787029 A  ERROR'
2018-11-25 19:23:07 [DEBUG   ] Got command BAM from MCS: ref #625613
2018-11-25 19:23:07 [INFO    ] Finished processing BAM request
2018-11-25 19:23:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625613   8 58447 69787033 A  ERROR'
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:23:07 [DEBUG   ] spawn_process: at 2018-11-25 19:23:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:23:17 [DEBUG   ] Got command BAM from MCS: ref #625614
2018-11-25 19:23:17 [INFO    ] Finished processing BAM request
2018-11-25 19:23:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625614   8 58447 69797033 A  ERROR'
2018-11-25 19:23:17 [DEBUG   ] Got command BAM from MCS: ref #625615
2018-11-25 19:23:17 [INFO    ] Finished processing BAM request
2018-11-25 19:23:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625615   8 58447 69797037 A  ERROR'
2018-11-25 19:23:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:23:17 [DEBUG   ] spawn_process: at 2018-11-25 19:23:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:23:27 [DEBUG   ] Got command BAM from MCS: ref #625617
2018-11-25 19:23:27 [INFO    ] Finished processing BAM request
2018-11-25 19:23:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625617   8 58447 69807025 A  ERROR'
2018-11-25 19:23:27 [DEBUG   ] Got command BAM from MCS: ref #625616
2018-11-25 19:23:27 [INFO    ] Finished processing BAM request
2018-11-25 19:23:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625616   8 58447 69807029 A  ERROR'
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:23:27 [DEBUG   ] spawn_process: at 2018-11-25 19:23:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:23:37 [DEBUG   ] Got command BAM from MCS: ref #625619
2018-11-25 19:23:37 [INFO    ] Finished processing BAM request
2018-11-25 19:23:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625619   8 58447 69817033 A  ERROR'
2018-11-25 19:23:37 [DEBUG   ] Got command BAM from MCS: ref #625618
2018-11-25 19:23:37 [INFO    ] Finished processing BAM request
2018-11-25 19:23:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625618   8 58447 69817037 A  ERROR'
2018-11-25 19:23:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:23:37 [DEBUG   ] spawn_process: at 2018-11-25 19:23:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:23:47 [DEBUG   ] Got command BAM from MCS: ref #625621
2018-11-25 19:23:47 [INFO    ] Finished processing BAM request
2018-11-25 19:23:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625621   8 58447 69827025 A  ERROR'
2018-11-25 19:23:47 [DEBUG   ] Got command BAM from MCS: ref #625620
2018-11-25 19:23:47 [INFO    ] Finished processing BAM request
2018-11-25 19:23:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625620   8 58447 69827029 A  ERROR'
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:23:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:23:47 [DEBUG   ] spawn_process: at 2018-11-25 19:23:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:23:56 [DEBUG   ] Got command BAM from MCS: ref #625623
2018-11-25 19:23:56 [INFO    ] Finished processing BAM request
2018-11-25 19:23:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625623   8 58447 69836025 A  ERROR'
2018-11-25 19:23:56 [DEBUG   ] Got command BAM from MCS: ref #625622
2018-11-25 19:23:56 [INFO    ] Finished processing BAM request
2018-11-25 19:23:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625622   8 58447 69836029 A  ERROR'
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:23:56 [DEBUG   ] spawn_process: at 2018-11-25 19:23:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:23:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-25 19:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:23:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:23:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:23:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:23:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:23:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:23:58 [DEBUG   ] Finished updating board flags in 1.289 seconds
2018-11-25 19:24:05 [DEBUG   ] Got command BAM from MCS: ref #625624
2018-11-25 19:24:05 [INFO    ] Finished processing BAM request
2018-11-25 19:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625624   8 58447 69845033 A  ERROR'
2018-11-25 19:24:05 [DEBUG   ] Got command BAM from MCS: ref #625625
2018-11-25 19:24:05 [INFO    ] Finished processing BAM request
2018-11-25 19:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625625   8 58447 69845037 A  ERROR'
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:24:05 [DEBUG   ] spawn_process: at 2018-11-25 19:24:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:24:14 [DEBUG   ] Got command BAM from MCS: ref #625626
2018-11-25 19:24:14 [INFO    ] Finished processing BAM request
2018-11-25 19:24:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625626   8 58447 69854033 A  ERROR'
2018-11-25 19:24:14 [DEBUG   ] Got command BAM from MCS: ref #625627
2018-11-25 19:24:14 [INFO    ] Finished processing BAM request
2018-11-25 19:24:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625627   8 58447 69854037 A  ERROR'
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:24:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:24:14 [DEBUG   ] spawn_process: at 2018-11-25 19:24:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:24:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:24:23 [DEBUG   ] Got command BAM from MCS: ref #625629
2018-11-25 19:24:23 [INFO    ] Finished processing BAM request
2018-11-25 19:24:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625629   8 58447 69863029 A  ERROR'
2018-11-25 19:24:23 [DEBUG   ] Got command BAM from MCS: ref #625628
2018-11-25 19:24:23 [INFO    ] Finished processing BAM request
2018-11-25 19:24:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625628   8 58447 69863033 A  ERROR'
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:24:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:24:23 [DEBUG   ] spawn_process: at 2018-11-25 19:24:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:24:32 [DEBUG   ] Got command BAM from MCS: ref #625630
2018-11-25 19:24:32 [INFO    ] Finished processing BAM request
2018-11-25 19:24:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625630   8 58447 69872025 A  ERROR'
2018-11-25 19:24:32 [DEBUG   ] Got command BAM from MCS: ref #625631
2018-11-25 19:24:32 [INFO    ] Finished processing BAM request
2018-11-25 19:24:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625631   8 58447 69872029 A  ERROR'
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:24:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:24:32 [DEBUG   ] spawn_process: at 2018-11-25 19:24:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:24:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:24:41 [DEBUG   ] Got command BAM from MCS: ref #625636
2018-11-25 19:24:41 [INFO    ] Finished processing BAM request
2018-11-25 19:24:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625636   8 58447 69881029 A  ERROR'
2018-11-25 19:24:41 [DEBUG   ] Got command BAM from MCS: ref #625637
2018-11-25 19:24:41 [INFO    ] Finished processing BAM request
2018-11-25 19:24:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625637   8 58447 69881033 A  ERROR'
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:24:41 [DEBUG   ] spawn_process: at 2018-11-25 19:24:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:24:50 [DEBUG   ] Got command BAM from MCS: ref #625639
2018-11-25 19:24:50 [INFO    ] Finished processing BAM request
2018-11-25 19:24:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625639   8 58447 69890025 A  ERROR'
2018-11-25 19:24:50 [DEBUG   ] Got command BAM from MCS: ref #625638
2018-11-25 19:24:50 [INFO    ] Finished processing BAM request
2018-11-25 19:24:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625638   8 58447 69890029 A  ERROR'
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:24:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:24:50 [DEBUG   ] spawn_process: at 2018-11-25 19:24:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:24:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:24:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 19:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:24:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 19:24:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:24:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:24:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:24:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:24:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:24:58 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-11-25 19:24:59 [DEBUG   ] Got command BAM from MCS: ref #625641
2018-11-25 19:24:59 [INFO    ] Finished processing BAM request
2018-11-25 19:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625641   8 58447 69899033 A  ERROR'
2018-11-25 19:24:59 [DEBUG   ] Got command BAM from MCS: ref #625640
2018-11-25 19:24:59 [INFO    ] Finished processing BAM request
2018-11-25 19:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625640   8 58447 69899037 A  ERROR'
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:24:59 [DEBUG   ] spawn_process: at 2018-11-25 19:24:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:25:08 [DEBUG   ] Got command BAM from MCS: ref #625642
2018-11-25 19:25:08 [INFO    ] Finished processing BAM request
2018-11-25 19:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625642   8 58447 69908029 A  ERROR'
2018-11-25 19:25:08 [DEBUG   ] Got command BAM from MCS: ref #625643
2018-11-25 19:25:08 [INFO    ] Finished processing BAM request
2018-11-25 19:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625643   8 58447 69908033 A  ERROR'
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:25:08 [DEBUG   ] spawn_process: at 2018-11-25 19:25:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:25:17 [DEBUG   ] Got command BAM from MCS: ref #625645
2018-11-25 19:25:17 [INFO    ] Finished processing BAM request
2018-11-25 19:25:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625645   8 58447 69917033 A  ERROR'
2018-11-25 19:25:17 [DEBUG   ] Got command BAM from MCS: ref #625644
2018-11-25 19:25:17 [INFO    ] Finished processing BAM request
2018-11-25 19:25:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625644   8 58447 69917037 A  ERROR'
2018-11-25 19:25:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:25:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:25:17 [DEBUG   ] spawn_process: at 2018-11-25 19:25:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:25:26 [DEBUG   ] Got command BAM from MCS: ref #625647
2018-11-25 19:25:26 [INFO    ] Finished processing BAM request
2018-11-25 19:25:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625647   8 58447 69926029 A  ERROR'
2018-11-25 19:25:26 [DEBUG   ] Got command BAM from MCS: ref #625646
2018-11-25 19:25:26 [INFO    ] Finished processing BAM request
2018-11-25 19:25:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625646   8 58447 69926033 A  ERROR'
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:25:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:25:26 [DEBUG   ] spawn_process: at 2018-11-25 19:25:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:25:35 [DEBUG   ] Got command BAM from MCS: ref #625649
2018-11-25 19:25:35 [INFO    ] Finished processing BAM request
2018-11-25 19:25:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625649   8 58447 69935041 A  ERROR'
2018-11-25 19:25:35 [DEBUG   ] Got command BAM from MCS: ref #625648
2018-11-25 19:25:35 [INFO    ] Finished processing BAM request
2018-11-25 19:25:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625648   8 58447 69935045 A  ERROR'
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:25:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:25:35 [DEBUG   ] spawn_process: at 2018-11-25 19:25:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:25:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:25:44 [DEBUG   ] Got command BAM from MCS: ref #625651
2018-11-25 19:25:44 [INFO    ] Finished processing BAM request
2018-11-25 19:25:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625651   8 58447 69944033 A  ERROR'
2018-11-25 19:25:44 [DEBUG   ] Got command BAM from MCS: ref #625650
2018-11-25 19:25:44 [INFO    ] Finished processing BAM request
2018-11-25 19:25:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625650   8 58447 69944037 A  ERROR'
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:25:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:25:44 [DEBUG   ] spawn_process: at 2018-11-25 19:25:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:25:48 [DEBUG   ] Got command RPT from MCS: ref #625652
2018-11-25 19:25:48 [DEBUG   ] summary = ERROR
2018-11-25 19:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625652  13 58447 69948477 A  ERRORERROR'
2018-11-25 19:25:48 [DEBUG   ] Got command RPT from MCS: ref #625653
2018-11-25 19:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625653  77 58447 69948478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:25:53 [DEBUG   ] Got command BAM from MCS: ref #625669
2018-11-25 19:25:53 [INFO    ] Finished processing BAM request
2018-11-25 19:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625669   8 58447 69953029 A  ERROR'
2018-11-25 19:25:53 [DEBUG   ] Got command BAM from MCS: ref #625670
2018-11-25 19:25:53 [INFO    ] Finished processing BAM request
2018-11-25 19:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625670   8 58447 69953033 A  ERROR'
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:25:53 [DEBUG   ] spawn_process: at 2018-11-25 19:25:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:25:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-25 19:25:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:25:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:25:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:25:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:25:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:25:58 [DEBUG   ] Finished updating board flags in 1.222 seconds
2018-11-25 19:26:02 [DEBUG   ] Got command BAM from MCS: ref #625672
2018-11-25 19:26:02 [INFO    ] Finished processing BAM request
2018-11-25 19:26:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625672   8 58447 69962033 A  ERROR'
2018-11-25 19:26:02 [DEBUG   ] Got command BAM from MCS: ref #625671
2018-11-25 19:26:02 [INFO    ] Finished processing BAM request
2018-11-25 19:26:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625671   8 58447 69962037 A  ERROR'
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:26:02 [DEBUG   ] spawn_process: at 2018-11-25 19:26:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:26:11 [DEBUG   ] Got command BAM from MCS: ref #625673
2018-11-25 19:26:11 [INFO    ] Finished processing BAM request
2018-11-25 19:26:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625673   8 58447 69971029 A  ERROR'
2018-11-25 19:26:11 [DEBUG   ] Got command BAM from MCS: ref #625674
2018-11-25 19:26:11 [INFO    ] Finished processing BAM request
2018-11-25 19:26:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625674   8 58447 69971033 A  ERROR'
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:26:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:26:11 [DEBUG   ] spawn_process: at 2018-11-25 19:26:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:26:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:26:20 [DEBUG   ] Got command BAM from MCS: ref #625675
2018-11-25 19:26:20 [INFO    ] Finished processing BAM request
2018-11-25 19:26:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625675   8 58447 69980025 A  ERROR'
2018-11-25 19:26:20 [DEBUG   ] Got command BAM from MCS: ref #625676
2018-11-25 19:26:20 [INFO    ] Finished processing BAM request
2018-11-25 19:26:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625676   8 58447 69980029 A  ERROR'
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:26:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:26:20 [DEBUG   ] spawn_process: at 2018-11-25 19:26:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:26:29 [DEBUG   ] Got command BAM from MCS: ref #625677
2018-11-25 19:26:29 [INFO    ] Finished processing BAM request
2018-11-25 19:26:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625677   8 58447 69989033 A  ERROR'
2018-11-25 19:26:29 [DEBUG   ] Got command BAM from MCS: ref #625678
2018-11-25 19:26:29 [INFO    ] Finished processing BAM request
2018-11-25 19:26:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625678   8 58447 69989037 A  ERROR'
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:26:29 [DEBUG   ] spawn_process: at 2018-11-25 19:26:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:26:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:26:38 [DEBUG   ] Got command BAM from MCS: ref #625680
2018-11-25 19:26:38 [INFO    ] Finished processing BAM request
2018-11-25 19:26:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625680   8 58447 69998033 A  ERROR'
2018-11-25 19:26:38 [DEBUG   ] Got command BAM from MCS: ref #625679
2018-11-25 19:26:38 [INFO    ] Finished processing BAM request
2018-11-25 19:26:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625679   8 58447 69998037 A  ERROR'
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:26:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:26:38 [DEBUG   ] spawn_process: at 2018-11-25 19:26:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:26:47 [DEBUG   ] Got command BAM from MCS: ref #625682
2018-11-25 19:26:47 [INFO    ] Finished processing BAM request
2018-11-25 19:26:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625682   8 58447 70007033 A  ERROR'
2018-11-25 19:26:47 [DEBUG   ] Got command BAM from MCS: ref #625681
2018-11-25 19:26:47 [INFO    ] Finished processing BAM request
2018-11-25 19:26:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625681   8 58447 70007037 A  ERROR'
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:26:47 [DEBUG   ] spawn_process: at 2018-11-25 19:26:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:26:56 [DEBUG   ] Got command BAM from MCS: ref #625684
2018-11-25 19:26:56 [INFO    ] Finished processing BAM request
2018-11-25 19:26:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625684   8 58447 70016033 A  ERROR'
2018-11-25 19:26:56 [DEBUG   ] Got command BAM from MCS: ref #625683
2018-11-25 19:26:56 [INFO    ] Finished processing BAM request
2018-11-25 19:26:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625683   8 58447 70016037 A  ERROR'
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:26:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:26:56 [DEBUG   ] spawn_process: at 2018-11-25 19:26:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:26:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:26:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:26:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:26:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:26:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:26:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:26:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:26:58 [DEBUG   ] Finished updating board flags in 1.116 seconds
2018-11-25 19:27:05 [DEBUG   ] Got command BAM from MCS: ref #625686
2018-11-25 19:27:05 [INFO    ] Finished processing BAM request
2018-11-25 19:27:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625686   8 58447 70025029 A  ERROR'
2018-11-25 19:27:05 [DEBUG   ] Got command BAM from MCS: ref #625685
2018-11-25 19:27:05 [INFO    ] Finished processing BAM request
2018-11-25 19:27:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625685   8 58447 70025033 A  ERROR'
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:27:05 [DEBUG   ] spawn_process: at 2018-11-25 19:27:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:27:14 [DEBUG   ] Got command BAM from MCS: ref #625688
2018-11-25 19:27:14 [INFO    ] Finished processing BAM request
2018-11-25 19:27:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625688   8 58447 70034025 A  ERROR'
2018-11-25 19:27:14 [DEBUG   ] Got command BAM from MCS: ref #625687
2018-11-25 19:27:14 [INFO    ] Finished processing BAM request
2018-11-25 19:27:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625687   8 58447 70034029 A  ERROR'
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:27:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:27:14 [DEBUG   ] spawn_process: at 2018-11-25 19:27:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:27:17 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-25 19:27:23 [DEBUG   ] Got command BAM from MCS: ref #625690
2018-11-25 19:27:23 [INFO    ] Finished processing BAM request
2018-11-25 19:27:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625690   8 58447 70043033 A  ERROR'
2018-11-25 19:27:23 [DEBUG   ] Got command BAM from MCS: ref #625689
2018-11-25 19:27:23 [INFO    ] Finished processing BAM request
2018-11-25 19:27:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625689   8 58447 70043037 A  ERROR'
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:27:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:27:23 [DEBUG   ] spawn_process: at 2018-11-25 19:27:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:27:24 [DEBUG   ] Got command RPT from MCS: ref #625691
2018-11-25 19:27:24 [DEBUG   ] summary = ERROR
2018-11-25 19:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625691  13 58447 70044021 A  ERRORERROR'
2018-11-25 19:27:24 [DEBUG   ] Got command RPT from MCS: ref #625692
2018-11-25 19:27:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625692  77 58447 70044225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:27:24 [DEBUG   ] Got command RPT from MCS: ref #625693
2018-11-25 19:27:24 [DEBUG   ] summary = ERROR
2018-11-25 19:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625693  13 58447 70044429 A  ERRORERROR'
2018-11-25 19:27:24 [DEBUG   ] Got command RPT from MCS: ref #625694
2018-11-25 19:27:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625694  77 58447 70044621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:27:24 [DEBUG   ] Got command RPT from MCS: ref #625695
2018-11-25 19:27:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:27:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625695  12 58447 70044825 A  ERRORB¢ff'
2018-11-25 19:27:32 [DEBUG   ] Got command BAM from MCS: ref #625696
2018-11-25 19:27:32 [INFO    ] Finished processing BAM request
2018-11-25 19:27:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625696   8 58447 70052029 A  ERROR'
2018-11-25 19:27:32 [DEBUG   ] Got command BAM from MCS: ref #625697
2018-11-25 19:27:32 [INFO    ] Finished processing BAM request
2018-11-25 19:27:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625697   8 58447 70052033 A  ERROR'
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:27:32 [DEBUG   ] spawn_process: at 2018-11-25 19:27:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:27:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:27:41 [DEBUG   ] Got command BAM from MCS: ref #625703
2018-11-25 19:27:41 [INFO    ] Finished processing BAM request
2018-11-25 19:27:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625703   8 58447 70061029 A  ERROR'
2018-11-25 19:27:41 [DEBUG   ] Got command BAM from MCS: ref #625702
2018-11-25 19:27:41 [INFO    ] Finished processing BAM request
2018-11-25 19:27:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625702   8 58447 70061033 A  ERROR'
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:27:41 [DEBUG   ] spawn_process: at 2018-11-25 19:27:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:27:50 [DEBUG   ] Got command BAM from MCS: ref #625704
2018-11-25 19:27:50 [INFO    ] Finished processing BAM request
2018-11-25 19:27:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625704   8 58447 70070025 A  ERROR'
2018-11-25 19:27:50 [DEBUG   ] Got command BAM from MCS: ref #625705
2018-11-25 19:27:50 [INFO    ] Finished processing BAM request
2018-11-25 19:27:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625705   8 58447 70070029 A  ERROR'
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:27:50 [DEBUG   ] spawn_process: at 2018-11-25 19:27:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:27:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:27:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:27:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:27:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:27:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:27:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:27:58 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-25 19:27:59 [DEBUG   ] Got command BAM from MCS: ref #625706
2018-11-25 19:27:59 [INFO    ] Finished processing BAM request
2018-11-25 19:27:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625706   8 58447 70079025 A  ERROR'
2018-11-25 19:27:59 [DEBUG   ] Got command BAM from MCS: ref #625707
2018-11-25 19:27:59 [INFO    ] Finished processing BAM request
2018-11-25 19:27:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:27:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625707   8 58447 70079029 A  ERROR'
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:27:59 [DEBUG   ] spawn_process: at 2018-11-25 19:27:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:28:08 [DEBUG   ] Got command BAM from MCS: ref #625709
2018-11-25 19:28:08 [INFO    ] Finished processing BAM request
2018-11-25 19:28:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625709   8 58447 70088033 A  ERROR'
2018-11-25 19:28:08 [DEBUG   ] Got command BAM from MCS: ref #625708
2018-11-25 19:28:08 [INFO    ] Finished processing BAM request
2018-11-25 19:28:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625708   8 58447 70088037 A  ERROR'
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:28:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:28:08 [DEBUG   ] spawn_process: at 2018-11-25 19:28:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:28:17 [DEBUG   ] Got command BAM from MCS: ref #625710
2018-11-25 19:28:17 [INFO    ] Finished processing BAM request
2018-11-25 19:28:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625710   8 58447 70097033 A  ERROR'
2018-11-25 19:28:17 [DEBUG   ] Got command BAM from MCS: ref #625711
2018-11-25 19:28:17 [INFO    ] Finished processing BAM request
2018-11-25 19:28:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625711   8 58447 70097037 A  ERROR'
2018-11-25 19:28:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:28:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:28:17 [DEBUG   ] spawn_process: at 2018-11-25 19:28:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:28:26 [DEBUG   ] Got command BAM from MCS: ref #625713
2018-11-25 19:28:26 [INFO    ] Finished processing BAM request
2018-11-25 19:28:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625713   8 58447 70106029 A  ERROR'
2018-11-25 19:28:26 [DEBUG   ] Got command BAM from MCS: ref #625712
2018-11-25 19:28:26 [INFO    ] Finished processing BAM request
2018-11-25 19:28:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625712   8 58447 70106033 A  ERROR'
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:28:26 [DEBUG   ] spawn_process: at 2018-11-25 19:28:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:28:35 [DEBUG   ] Got command BAM from MCS: ref #625714
2018-11-25 19:28:35 [INFO    ] Finished processing BAM request
2018-11-25 19:28:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625714   8 58447 70115025 A  ERROR'
2018-11-25 19:28:35 [DEBUG   ] Got command BAM from MCS: ref #625715
2018-11-25 19:28:35 [INFO    ] Finished processing BAM request
2018-11-25 19:28:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625715   8 58447 70115029 A  ERROR'
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:28:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:28:35 [DEBUG   ] spawn_process: at 2018-11-25 19:28:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:28:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:28:44 [DEBUG   ] Got command BAM from MCS: ref #625716
2018-11-25 19:28:44 [INFO    ] Finished processing BAM request
2018-11-25 19:28:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625716   8 58447 70124025 A  ERROR'
2018-11-25 19:28:44 [DEBUG   ] Got command BAM from MCS: ref #625717
2018-11-25 19:28:44 [INFO    ] Finished processing BAM request
2018-11-25 19:28:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625717   8 58447 70124029 A  ERROR'
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:28:44 [DEBUG   ] spawn_process: at 2018-11-25 19:28:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:28:53 [DEBUG   ] Got command BAM from MCS: ref #625719
2018-11-25 19:28:53 [INFO    ] Finished processing BAM request
2018-11-25 19:28:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625719   8 58447 70133033 A  ERROR'
2018-11-25 19:28:53 [DEBUG   ] Got command BAM from MCS: ref #625718
2018-11-25 19:28:53 [INFO    ] Finished processing BAM request
2018-11-25 19:28:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:28:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625718   8 58447 70133037 A  ERROR'
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:28:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:28:53 [DEBUG   ] spawn_process: at 2018-11-25 19:28:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:28:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 19:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:28:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:28:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:28:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:28:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:28:58 [WARNING ] (13, 1, 'bot')
2018-11-25 19:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:28:58 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-11-25 19:29:02 [DEBUG   ] Got command BAM from MCS: ref #625721
2018-11-25 19:29:02 [INFO    ] Finished processing BAM request
2018-11-25 19:29:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625721   8 58447 70142033 A  ERROR'
2018-11-25 19:29:02 [DEBUG   ] Got command BAM from MCS: ref #625720
2018-11-25 19:29:02 [INFO    ] Finished processing BAM request
2018-11-25 19:29:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625720   8 58447 70142037 A  ERROR'
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:29:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:29:02 [DEBUG   ] spawn_process: at 2018-11-25 19:29:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:29:11 [DEBUG   ] Got command BAM from MCS: ref #625722
2018-11-25 19:29:11 [INFO    ] Finished processing BAM request
2018-11-25 19:29:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625722   8 58447 70151033 A  ERROR'
2018-11-25 19:29:11 [DEBUG   ] Got command BAM from MCS: ref #625723
2018-11-25 19:29:11 [INFO    ] Finished processing BAM request
2018-11-25 19:29:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625723   8 58447 70151037 A  ERROR'
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:29:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:29:11 [DEBUG   ] spawn_process: at 2018-11-25 19:29:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:29:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:29:20 [DEBUG   ] Got command BAM from MCS: ref #625725
2018-11-25 19:29:20 [INFO    ] Finished processing BAM request
2018-11-25 19:29:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625725   8 58447 70160029 A  ERROR'
2018-11-25 19:29:20 [DEBUG   ] Got command BAM from MCS: ref #625724
2018-11-25 19:29:20 [INFO    ] Finished processing BAM request
2018-11-25 19:29:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625724   8 58447 70160033 A  ERROR'
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:29:20 [DEBUG   ] spawn_process: at 2018-11-25 19:29:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:29:29 [DEBUG   ] Got command BAM from MCS: ref #625727
2018-11-25 19:29:29 [INFO    ] Finished processing BAM request
2018-11-25 19:29:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625727   8 58447 70169025 A  ERROR'
2018-11-25 19:29:29 [DEBUG   ] Got command BAM from MCS: ref #625726
2018-11-25 19:29:29 [INFO    ] Finished processing BAM request
2018-11-25 19:29:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625726   8 58447 70169029 A  ERROR'
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:29:29 [DEBUG   ] spawn_process: at 2018-11-25 19:29:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:29:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:29:38 [DEBUG   ] Got command BAM from MCS: ref #625728
2018-11-25 19:29:38 [INFO    ] Finished processing BAM request
2018-11-25 19:29:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625728   8 58447 70178025 A  ERROR'
2018-11-25 19:29:38 [DEBUG   ] Got command BAM from MCS: ref #625729
2018-11-25 19:29:38 [INFO    ] Finished processing BAM request
2018-11-25 19:29:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625729   8 58447 70178029 A  ERROR'
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:29:38 [DEBUG   ] spawn_process: at 2018-11-25 19:29:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:29:47 [DEBUG   ] Got command BAM from MCS: ref #625731
2018-11-25 19:29:47 [INFO    ] Finished processing BAM request
2018-11-25 19:29:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625731   8 58447 70187025 A  ERROR'
2018-11-25 19:29:47 [DEBUG   ] Got command BAM from MCS: ref #625730
2018-11-25 19:29:47 [INFO    ] Finished processing BAM request
2018-11-25 19:29:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625730   8 58447 70187029 A  ERROR'
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:29:47 [DEBUG   ] spawn_process: at 2018-11-25 19:29:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:29:56 [DEBUG   ] Got command BAM from MCS: ref #625732
2018-11-25 19:29:56 [INFO    ] Finished processing BAM request
2018-11-25 19:29:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625732   8 58447 70196033 A  ERROR'
2018-11-25 19:29:56 [DEBUG   ] Got command BAM from MCS: ref #625733
2018-11-25 19:29:56 [INFO    ] Finished processing BAM request
2018-11-25 19:29:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625733   8 58447 70196037 A  ERROR'
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:29:56 [DEBUG   ] spawn_process: at 2018-11-25 19:29:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:29:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:29:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:29:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:29:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:29:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:29:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:29:59 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-11-25 19:30:05 [DEBUG   ] Got command BAM from MCS: ref #625735
2018-11-25 19:30:05 [INFO    ] Finished processing BAM request
2018-11-25 19:30:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625735   8 58447 70205025 A  ERROR'
2018-11-25 19:30:05 [DEBUG   ] Got command BAM from MCS: ref #625734
2018-11-25 19:30:05 [INFO    ] Finished processing BAM request
2018-11-25 19:30:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625734   8 58447 70205029 A  ERROR'
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:30:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:30:05 [DEBUG   ] spawn_process: at 2018-11-25 19:30:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:30:14 [DEBUG   ] Got command BAM from MCS: ref #625736
2018-11-25 19:30:14 [INFO    ] Finished processing BAM request
2018-11-25 19:30:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625736   8 58447 70214025 A  ERROR'
2018-11-25 19:30:14 [DEBUG   ] Got command BAM from MCS: ref #625737
2018-11-25 19:30:14 [INFO    ] Finished processing BAM request
2018-11-25 19:30:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625737   8 58447 70214029 A  ERROR'
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:30:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:30:14 [DEBUG   ] spawn_process: at 2018-11-25 19:30:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:30:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 19:30:23 [DEBUG   ] Got command BAM from MCS: ref #625739
2018-11-25 19:30:23 [INFO    ] Finished processing BAM request
2018-11-25 19:30:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625739   8 58447 70223029 A  ERROR'
2018-11-25 19:30:23 [DEBUG   ] Got command BAM from MCS: ref #625738
2018-11-25 19:30:23 [INFO    ] Finished processing BAM request
2018-11-25 19:30:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625738   8 58447 70223033 A  ERROR'
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:30:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:30:23 [DEBUG   ] spawn_process: at 2018-11-25 19:30:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:30:32 [DEBUG   ] Got command BAM from MCS: ref #625741
2018-11-25 19:30:32 [INFO    ] Finished processing BAM request
2018-11-25 19:30:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625741   8 58447 70232025 A  ERROR'
2018-11-25 19:30:32 [DEBUG   ] Got command BAM from MCS: ref #625740
2018-11-25 19:30:32 [INFO    ] Finished processing BAM request
2018-11-25 19:30:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625740   8 58447 70232029 A  ERROR'
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:30:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:30:32 [DEBUG   ] spawn_process: at 2018-11-25 19:30:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:30:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:30:41 [DEBUG   ] Got command BAM from MCS: ref #625747
2018-11-25 19:30:41 [INFO    ] Finished processing BAM request
2018-11-25 19:30:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625747   8 58447 70241025 A  ERROR'
2018-11-25 19:30:41 [DEBUG   ] Got command BAM from MCS: ref #625746
2018-11-25 19:30:41 [INFO    ] Finished processing BAM request
2018-11-25 19:30:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625746   8 58447 70241029 A  ERROR'
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:30:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:30:41 [DEBUG   ] spawn_process: at 2018-11-25 19:30:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:30:48 [DEBUG   ] Got command RPT from MCS: ref #625748
2018-11-25 19:30:48 [DEBUG   ] summary = ERROR
2018-11-25 19:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625748  13 58447 70248473 A  ERRORERROR'
2018-11-25 19:30:48 [DEBUG   ] Got command RPT from MCS: ref #625749
2018-11-25 19:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625749  77 58447 70248474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:30:50 [DEBUG   ] Got command BAM from MCS: ref #625766
2018-11-25 19:30:50 [INFO    ] Finished processing BAM request
2018-11-25 19:30:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625766   8 58447 70250025 A  ERROR'
2018-11-25 19:30:50 [DEBUG   ] Got command BAM from MCS: ref #625765
2018-11-25 19:30:50 [INFO    ] Finished processing BAM request
2018-11-25 19:30:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625765   8 58447 70250029 A  ERROR'
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:30:50 [DEBUG   ] spawn_process: at 2018-11-25 19:30:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:30:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 19:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:30:59 [DEBUG   ] Got command BAM from MCS: ref #625767
2018-11-25 19:30:59 [INFO    ] Finished processing BAM request
2018-11-25 19:30:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625767   8 58447 70259037 A  ERROR'
2018-11-25 19:30:59 [DEBUG   ] Got command BAM from MCS: ref #625768
2018-11-25 19:30:59 [INFO    ] Finished processing BAM request
2018-11-25 19:30:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625768   8 58447 70259045 A  ERROR'
2018-11-25 19:30:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:30:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:30:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:30:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:30:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:30:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:30:59 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:30:59 [DEBUG   ] spawn_process: at 2018-11-25 19:30:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:31:08 [DEBUG   ] Got command BAM from MCS: ref #625769
2018-11-25 19:31:08 [INFO    ] Finished processing BAM request
2018-11-25 19:31:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625769   8 58447 70268033 A  ERROR'
2018-11-25 19:31:08 [DEBUG   ] Got command BAM from MCS: ref #625770
2018-11-25 19:31:08 [INFO    ] Finished processing BAM request
2018-11-25 19:31:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625770   8 58447 70268041 A  ERROR'
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:31:08 [DEBUG   ] spawn_process: at 2018-11-25 19:31:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:31:17 [DEBUG   ] Got command BAM from MCS: ref #625772
2018-11-25 19:31:17 [INFO    ] Finished processing BAM request
2018-11-25 19:31:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625772   8 58447 70277033 A  ERROR'
2018-11-25 19:31:17 [DEBUG   ] Got command BAM from MCS: ref #625771
2018-11-25 19:31:17 [INFO    ] Finished processing BAM request
2018-11-25 19:31:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625771   8 58447 70277041 A  ERROR'
2018-11-25 19:31:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:31:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:31:17 [DEBUG   ] spawn_process: at 2018-11-25 19:31:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:31:26 [DEBUG   ] Got command BAM from MCS: ref #625774
2018-11-25 19:31:26 [INFO    ] Finished processing BAM request
2018-11-25 19:31:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625774   8 58447 70286033 A  ERROR'
2018-11-25 19:31:26 [DEBUG   ] Got command BAM from MCS: ref #625773
2018-11-25 19:31:26 [INFO    ] Finished processing BAM request
2018-11-25 19:31:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625773   8 58447 70286041 A  ERROR'
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:31:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:31:26 [DEBUG   ] spawn_process: at 2018-11-25 19:31:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:31:35 [DEBUG   ] Got command BAM from MCS: ref #625776
2018-11-25 19:31:35 [INFO    ] Finished processing BAM request
2018-11-25 19:31:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625776   8 58447 70295037 A  ERROR'
2018-11-25 19:31:35 [DEBUG   ] Got command BAM from MCS: ref #625775
2018-11-25 19:31:35 [INFO    ] Finished processing BAM request
2018-11-25 19:31:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625775   8 58447 70295041 A  ERROR'
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:31:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:31:35 [DEBUG   ] spawn_process: at 2018-11-25 19:31:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:31:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 19:31:44 [DEBUG   ] Got command BAM from MCS: ref #625777
2018-11-25 19:31:44 [INFO    ] Finished processing BAM request
2018-11-25 19:31:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625777   8 58447 70304029 A  ERROR'
2018-11-25 19:31:44 [DEBUG   ] Got command BAM from MCS: ref #625778
2018-11-25 19:31:44 [INFO    ] Finished processing BAM request
2018-11-25 19:31:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625778   8 58447 70304033 A  ERROR'
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:31:44 [DEBUG   ] spawn_process: at 2018-11-25 19:31:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:31:53 [DEBUG   ] Got command BAM from MCS: ref #625779
2018-11-25 19:31:53 [INFO    ] Finished processing BAM request
2018-11-25 19:31:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625779   8 58447 70313025 A  ERROR'
2018-11-25 19:31:53 [DEBUG   ] Got command BAM from MCS: ref #625780
2018-11-25 19:31:53 [INFO    ] Finished processing BAM request
2018-11-25 19:31:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625780   8 58447 70313029 A  ERROR'
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:31:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:31:53 [DEBUG   ] spawn_process: at 2018-11-25 19:31:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:31:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:31:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:31:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:31:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:31:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:31:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:31:59 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-11-25 19:32:02 [DEBUG   ] Got command BAM from MCS: ref #625781
2018-11-25 19:32:02 [INFO    ] Finished processing BAM request
2018-11-25 19:32:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625781   8 58447 70322033 A  ERROR'
2018-11-25 19:32:02 [DEBUG   ] Got command BAM from MCS: ref #625782
2018-11-25 19:32:02 [INFO    ] Finished processing BAM request
2018-11-25 19:32:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625782   8 58447 70322037 A  ERROR'
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:32:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:32:02 [DEBUG   ] spawn_process: at 2018-11-25 19:32:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:32:12 [DEBUG   ] Got command BAM from MCS: ref #625785
2018-11-25 19:32:12 [INFO    ] Finished processing BAM request
2018-11-25 19:32:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625785   8 58447 70332025 A  ERROR'
2018-11-25 19:32:12 [DEBUG   ] Got command BAM from MCS: ref #625786
2018-11-25 19:32:12 [INFO    ] Finished processing BAM request
2018-11-25 19:32:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625786   8 58447 70332029 A  ERROR'
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:32:12 [DEBUG   ] spawn_process: at 2018-11-25 19:32:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:32:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:32:22 [DEBUG   ] Got command BAM from MCS: ref #625788
2018-11-25 19:32:22 [INFO    ] Finished processing BAM request
2018-11-25 19:32:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625788   8 58447 70342025 A  ERROR'
2018-11-25 19:32:22 [DEBUG   ] Got command BAM from MCS: ref #625787
2018-11-25 19:32:22 [INFO    ] Finished processing BAM request
2018-11-25 19:32:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625787   8 58447 70342033 A  ERROR'
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:32:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:32:22 [DEBUG   ] spawn_process: at 2018-11-25 19:32:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:32:24 [DEBUG   ] Got command RPT from MCS: ref #625789
2018-11-25 19:32:24 [DEBUG   ] summary = ERROR
2018-11-25 19:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625789  13 58447 70344109 A  ERRORERROR'
2018-11-25 19:32:24 [DEBUG   ] Got command RPT from MCS: ref #625790
2018-11-25 19:32:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625790  77 58447 70344313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:32:24 [DEBUG   ] Got command RPT from MCS: ref #625791
2018-11-25 19:32:24 [DEBUG   ] summary = ERROR
2018-11-25 19:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625791  13 58447 70344505 A  ERRORERROR'
2018-11-25 19:32:24 [DEBUG   ] Got command RPT from MCS: ref #625793
2018-11-25 19:32:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625793  77 58447 70344709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:32:24 [DEBUG   ] Got command RPT from MCS: ref #625794
2018-11-25 19:32:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625794  12 58447 70344913 A  ERRORB£ff'
2018-11-25 19:32:32 [DEBUG   ] Got command BAM from MCS: ref #625799
2018-11-25 19:32:32 [INFO    ] Finished processing BAM request
2018-11-25 19:32:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625799   8 58447 70352033 A  ERROR'
2018-11-25 19:32:32 [DEBUG   ] Got command BAM from MCS: ref #625800
2018-11-25 19:32:32 [INFO    ] Finished processing BAM request
2018-11-25 19:32:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625800   8 58447 70352037 A  ERROR'
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:32:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:32:32 [DEBUG   ] spawn_process: at 2018-11-25 19:32:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:32:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:32:42 [DEBUG   ] Got command BAM from MCS: ref #625801
2018-11-25 19:32:42 [INFO    ] Finished processing BAM request
2018-11-25 19:32:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625801   8 58447 70362025 A  ERROR'
2018-11-25 19:32:42 [DEBUG   ] Got command BAM from MCS: ref #625802
2018-11-25 19:32:42 [INFO    ] Finished processing BAM request
2018-11-25 19:32:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625802   8 58447 70362033 A  ERROR'
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:32:42 [DEBUG   ] spawn_process: at 2018-11-25 19:32:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:32:52 [DEBUG   ] Got command BAM from MCS: ref #625804
2018-11-25 19:32:52 [INFO    ] Finished processing BAM request
2018-11-25 19:32:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625804   8 58447 70372033 A  ERROR'
2018-11-25 19:32:52 [DEBUG   ] Got command BAM from MCS: ref #625803
2018-11-25 19:32:52 [INFO    ] Finished processing BAM request
2018-11-25 19:32:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:32:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625803   8 58447 70372037 A  ERROR'
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:32:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:32:52 [DEBUG   ] spawn_process: at 2018-11-25 19:32:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:32:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-25 19:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:32:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:32:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:32:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:32:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:32:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:32:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:32:59 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-25 19:33:02 [DEBUG   ] Got command BAM from MCS: ref #625805
2018-11-25 19:33:02 [INFO    ] Finished processing BAM request
2018-11-25 19:33:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625805   8 58447 70382025 A  ERROR'
2018-11-25 19:33:02 [DEBUG   ] Got command BAM from MCS: ref #625806
2018-11-25 19:33:02 [INFO    ] Finished processing BAM request
2018-11-25 19:33:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625806   8 58447 70382029 A  ERROR'
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:33:02 [DEBUG   ] spawn_process: at 2018-11-25 19:33:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:33:12 [DEBUG   ] Got command BAM from MCS: ref #625808
2018-11-25 19:33:12 [INFO    ] Finished processing BAM request
2018-11-25 19:33:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625808   8 58447 70392029 A  ERROR'
2018-11-25 19:33:12 [DEBUG   ] Got command BAM from MCS: ref #625807
2018-11-25 19:33:12 [INFO    ] Finished processing BAM request
2018-11-25 19:33:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625807   8 58447 70392033 A  ERROR'
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:33:12 [DEBUG   ] spawn_process: at 2018-11-25 19:33:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:33:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:33:22 [DEBUG   ] Got command BAM from MCS: ref #625809
2018-11-25 19:33:22 [INFO    ] Finished processing BAM request
2018-11-25 19:33:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625809   8 58447 70402033 A  ERROR'
2018-11-25 19:33:22 [DEBUG   ] Got command BAM from MCS: ref #625810
2018-11-25 19:33:22 [INFO    ] Finished processing BAM request
2018-11-25 19:33:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625810   8 58447 70402037 A  ERROR'
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:33:22 [DEBUG   ] spawn_process: at 2018-11-25 19:33:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:33:32 [DEBUG   ] Got command BAM from MCS: ref #625812
2018-11-25 19:33:32 [INFO    ] Finished processing BAM request
2018-11-25 19:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625812   8 58447 70412025 A  ERROR'
2018-11-25 19:33:32 [DEBUG   ] Got command BAM from MCS: ref #625811
2018-11-25 19:33:32 [INFO    ] Finished processing BAM request
2018-11-25 19:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625811   8 58447 70412029 A  ERROR'
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:33:32 [DEBUG   ] spawn_process: at 2018-11-25 19:33:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:33:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:33:42 [DEBUG   ] Got command BAM from MCS: ref #625817
2018-11-25 19:33:42 [INFO    ] Finished processing BAM request
2018-11-25 19:33:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625817   8 58447 70422029 A  ERROR'
2018-11-25 19:33:42 [DEBUG   ] Got command BAM from MCS: ref #625818
2018-11-25 19:33:42 [INFO    ] Finished processing BAM request
2018-11-25 19:33:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625818   8 58447 70422033 A  ERROR'
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:33:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:33:42 [DEBUG   ] spawn_process: at 2018-11-25 19:33:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:33:52 [DEBUG   ] Got command BAM from MCS: ref #625819
2018-11-25 19:33:52 [INFO    ] Finished processing BAM request
2018-11-25 19:33:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625819   8 58447 70432033 A  ERROR'
2018-11-25 19:33:52 [DEBUG   ] Got command BAM from MCS: ref #625820
2018-11-25 19:33:52 [INFO    ] Finished processing BAM request
2018-11-25 19:33:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:33:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625820   8 58447 70432037 A  ERROR'
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:33:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:33:52 [DEBUG   ] spawn_process: at 2018-11-25 19:33:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:33:57 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-25 19:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:33:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-25 19:33:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:33:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:33:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:33:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:33:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:33:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:33:59 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-25 19:34:02 [DEBUG   ] Got command BAM from MCS: ref #625821
2018-11-25 19:34:02 [INFO    ] Finished processing BAM request
2018-11-25 19:34:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625821   8 58447 70442029 A  ERROR'
2018-11-25 19:34:02 [DEBUG   ] Got command BAM from MCS: ref #625822
2018-11-25 19:34:02 [INFO    ] Finished processing BAM request
2018-11-25 19:34:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625822   8 58447 70442033 A  ERROR'
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:34:02 [DEBUG   ] spawn_process: at 2018-11-25 19:34:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:34:12 [DEBUG   ] Got command BAM from MCS: ref #625823
2018-11-25 19:34:12 [INFO    ] Finished processing BAM request
2018-11-25 19:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625823   8 58447 70452033 A  ERROR'
2018-11-25 19:34:12 [DEBUG   ] Got command BAM from MCS: ref #625824
2018-11-25 19:34:12 [INFO    ] Finished processing BAM request
2018-11-25 19:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625824   8 58447 70452037 A  ERROR'
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:34:12 [DEBUG   ] spawn_process: at 2018-11-25 19:34:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:34:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:34:22 [DEBUG   ] Got command BAM from MCS: ref #625826
2018-11-25 19:34:22 [INFO    ] Finished processing BAM request
2018-11-25 19:34:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625826   8 58447 70462029 A  ERROR'
2018-11-25 19:34:22 [DEBUG   ] Got command BAM from MCS: ref #625825
2018-11-25 19:34:22 [INFO    ] Finished processing BAM request
2018-11-25 19:34:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625825   8 58447 70462033 A  ERROR'
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:34:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:34:22 [DEBUG   ] spawn_process: at 2018-11-25 19:34:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:34:32 [DEBUG   ] Got command BAM from MCS: ref #625827
2018-11-25 19:34:32 [INFO    ] Finished processing BAM request
2018-11-25 19:34:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625827   8 58447 70472033 A  ERROR'
2018-11-25 19:34:32 [DEBUG   ] Got command BAM from MCS: ref #625828
2018-11-25 19:34:32 [INFO    ] Finished processing BAM request
2018-11-25 19:34:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625828   8 58447 70472037 A  ERROR'
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:34:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:34:32 [DEBUG   ] spawn_process: at 2018-11-25 19:34:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:34:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 19:34:42 [DEBUG   ] Got command BAM from MCS: ref #625830
2018-11-25 19:34:42 [INFO    ] Finished processing BAM request
2018-11-25 19:34:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625830   8 58447 70482025 A  ERROR'
2018-11-25 19:34:42 [DEBUG   ] Got command BAM from MCS: ref #625829
2018-11-25 19:34:42 [INFO    ] Finished processing BAM request
2018-11-25 19:34:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625829   8 58447 70482029 A  ERROR'
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:34:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:34:42 [DEBUG   ] spawn_process: at 2018-11-25 19:34:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:34:52 [DEBUG   ] Got command BAM from MCS: ref #625832
2018-11-25 19:34:52 [INFO    ] Finished processing BAM request
2018-11-25 19:34:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625832   8 58447 70492029 A  ERROR'
2018-11-25 19:34:52 [DEBUG   ] Got command BAM from MCS: ref #625831
2018-11-25 19:34:52 [INFO    ] Finished processing BAM request
2018-11-25 19:34:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625831   8 58447 70492033 A  ERROR'
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:34:52 [DEBUG   ] spawn_process: at 2018-11-25 19:34:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:34:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:35:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:35:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:35:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:35:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:35:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:35:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:35:00 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-11-25 19:35:02 [DEBUG   ] Got command BAM from MCS: ref #625834
2018-11-25 19:35:02 [INFO    ] Finished processing BAM request
2018-11-25 19:35:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625834   8 58447 70502033 A  ERROR'
2018-11-25 19:35:02 [DEBUG   ] Got command BAM from MCS: ref #625833
2018-11-25 19:35:02 [INFO    ] Finished processing BAM request
2018-11-25 19:35:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625833   8 58447 70502037 A  ERROR'
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:35:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:35:02 [DEBUG   ] spawn_process: at 2018-11-25 19:35:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:35:12 [DEBUG   ] Got command BAM from MCS: ref #625836
2018-11-25 19:35:12 [INFO    ] Finished processing BAM request
2018-11-25 19:35:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625836   8 58447 70512029 A  ERROR'
2018-11-25 19:35:12 [DEBUG   ] Got command BAM from MCS: ref #625835
2018-11-25 19:35:12 [INFO    ] Finished processing BAM request
2018-11-25 19:35:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625835   8 58447 70512033 A  ERROR'
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:35:12 [DEBUG   ] spawn_process: at 2018-11-25 19:35:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:35:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:35:22 [DEBUG   ] Got command BAM from MCS: ref #625838
2018-11-25 19:35:22 [INFO    ] Finished processing BAM request
2018-11-25 19:35:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625838   8 58447 70522029 A  ERROR'
2018-11-25 19:35:22 [DEBUG   ] Got command BAM from MCS: ref #625837
2018-11-25 19:35:22 [INFO    ] Finished processing BAM request
2018-11-25 19:35:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625837   8 58447 70522033 A  ERROR'
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:35:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:35:22 [DEBUG   ] spawn_process: at 2018-11-25 19:35:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:35:32 [DEBUG   ] Got command BAM from MCS: ref #625839
2018-11-25 19:35:32 [INFO    ] Finished processing BAM request
2018-11-25 19:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625839   8 58447 70532025 A  ERROR'
2018-11-25 19:35:32 [DEBUG   ] Got command BAM from MCS: ref #625840
2018-11-25 19:35:32 [INFO    ] Finished processing BAM request
2018-11-25 19:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625840   8 58447 70532029 A  ERROR'
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:35:32 [DEBUG   ] spawn_process: at 2018-11-25 19:35:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:35:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 19:35:42 [DEBUG   ] Got command BAM from MCS: ref #625842
2018-11-25 19:35:42 [INFO    ] Finished processing BAM request
2018-11-25 19:35:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625842   8 58447 70542025 A  ERROR'
2018-11-25 19:35:42 [DEBUG   ] Got command BAM from MCS: ref #625841
2018-11-25 19:35:42 [INFO    ] Finished processing BAM request
2018-11-25 19:35:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625841   8 58447 70542029 A  ERROR'
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:35:42 [DEBUG   ] spawn_process: at 2018-11-25 19:35:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:35:48 [DEBUG   ] Got command RPT from MCS: ref #625843
2018-11-25 19:35:48 [DEBUG   ] summary = ERROR
2018-11-25 19:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625843  13 58447 70548473 A  ERRORERROR'
2018-11-25 19:35:48 [DEBUG   ] Got command RPT from MCS: ref #625844
2018-11-25 19:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625844  77 58447 70548474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:35:52 [DEBUG   ] Got command BAM from MCS: ref #625860
2018-11-25 19:35:52 [INFO    ] Finished processing BAM request
2018-11-25 19:35:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625860   8 58447 70552029 A  ERROR'
2018-11-25 19:35:52 [DEBUG   ] Got command BAM from MCS: ref #625861
2018-11-25 19:35:52 [INFO    ] Finished processing BAM request
2018-11-25 19:35:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:35:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625861   8 58447 70552033 A  ERROR'
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:35:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:35:52 [DEBUG   ] spawn_process: at 2018-11-25 19:35:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:35:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 19:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-25 19:35:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:35:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:35:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:35:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:35:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:35:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:35:59 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-11-25 19:36:02 [DEBUG   ] Got command BAM from MCS: ref #625863
2018-11-25 19:36:02 [INFO    ] Finished processing BAM request
2018-11-25 19:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625863   8 58447 70562029 A  ERROR'
2018-11-25 19:36:02 [DEBUG   ] Got command BAM from MCS: ref #625862
2018-11-25 19:36:02 [INFO    ] Finished processing BAM request
2018-11-25 19:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625862   8 58447 70562033 A  ERROR'
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:36:02 [DEBUG   ] spawn_process: at 2018-11-25 19:36:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:36:12 [DEBUG   ] Got command BAM from MCS: ref #625864
2018-11-25 19:36:12 [INFO    ] Finished processing BAM request
2018-11-25 19:36:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625864   8 58447 70572033 A  ERROR'
2018-11-25 19:36:12 [DEBUG   ] Got command BAM from MCS: ref #625865
2018-11-25 19:36:12 [INFO    ] Finished processing BAM request
2018-11-25 19:36:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625865   8 58447 70572037 A  ERROR'
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:36:12 [DEBUG   ] spawn_process: at 2018-11-25 19:36:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:36:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 19:36:22 [DEBUG   ] Got command BAM from MCS: ref #625866
2018-11-25 19:36:22 [INFO    ] Finished processing BAM request
2018-11-25 19:36:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625866   8 58447 70582029 A  ERROR'
2018-11-25 19:36:22 [DEBUG   ] Got command BAM from MCS: ref #625867
2018-11-25 19:36:22 [INFO    ] Finished processing BAM request
2018-11-25 19:36:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625867   8 58447 70582033 A  ERROR'
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:36:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:36:22 [DEBUG   ] spawn_process: at 2018-11-25 19:36:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:36:32 [DEBUG   ] Got command BAM from MCS: ref #625868
2018-11-25 19:36:32 [INFO    ] Finished processing BAM request
2018-11-25 19:36:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625868   8 58447 70592033 A  ERROR'
2018-11-25 19:36:32 [DEBUG   ] Got command BAM from MCS: ref #625869
2018-11-25 19:36:32 [INFO    ] Finished processing BAM request
2018-11-25 19:36:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625869   8 58447 70592037 A  ERROR'
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:36:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:36:32 [DEBUG   ] spawn_process: at 2018-11-25 19:36:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:36:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:36:42 [DEBUG   ] Got command BAM from MCS: ref #625875
2018-11-25 19:36:42 [INFO    ] Finished processing BAM request
2018-11-25 19:36:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625875   8 58447 70602025 A  ERROR'
2018-11-25 19:36:42 [DEBUG   ] Got command BAM from MCS: ref #625874
2018-11-25 19:36:42 [INFO    ] Finished processing BAM request
2018-11-25 19:36:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625874   8 58447 70602029 A  ERROR'
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:36:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:36:42 [DEBUG   ] spawn_process: at 2018-11-25 19:36:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:36:52 [DEBUG   ] Got command BAM from MCS: ref #625876
2018-11-25 19:36:52 [INFO    ] Finished processing BAM request
2018-11-25 19:36:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625876   8 58447 70612033 A  ERROR'
2018-11-25 19:36:52 [DEBUG   ] Got command BAM from MCS: ref #625877
2018-11-25 19:36:52 [INFO    ] Finished processing BAM request
2018-11-25 19:36:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625877   8 58447 70612037 A  ERROR'
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:36:52 [DEBUG   ] spawn_process: at 2018-11-25 19:36:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:36:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:36:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:36:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:36:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:36:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:36:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:36:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:36:59 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-11-25 19:37:02 [DEBUG   ] Got command BAM from MCS: ref #625878
2018-11-25 19:37:02 [INFO    ] Finished processing BAM request
2018-11-25 19:37:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625878   8 58447 70622025 A  ERROR'
2018-11-25 19:37:02 [DEBUG   ] Got command BAM from MCS: ref #625879
2018-11-25 19:37:02 [INFO    ] Finished processing BAM request
2018-11-25 19:37:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625879   8 58447 70622029 A  ERROR'
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:37:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:37:02 [DEBUG   ] spawn_process: at 2018-11-25 19:37:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:37:12 [DEBUG   ] Got command BAM from MCS: ref #625881
2018-11-25 19:37:12 [INFO    ] Finished processing BAM request
2018-11-25 19:37:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625881   8 58447 70632029 A  ERROR'
2018-11-25 19:37:12 [DEBUG   ] Got command BAM from MCS: ref #625880
2018-11-25 19:37:12 [INFO    ] Finished processing BAM request
2018-11-25 19:37:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625880   8 58447 70632033 A  ERROR'
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:37:12 [DEBUG   ] spawn_process: at 2018-11-25 19:37:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:37:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:37:22 [DEBUG   ] Got command BAM from MCS: ref #625883
2018-11-25 19:37:22 [INFO    ] Finished processing BAM request
2018-11-25 19:37:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625883   8 58447 70642033 A  ERROR'
2018-11-25 19:37:22 [DEBUG   ] Got command BAM from MCS: ref #625882
2018-11-25 19:37:22 [INFO    ] Finished processing BAM request
2018-11-25 19:37:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625882   8 58447 70642037 A  ERROR'
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:37:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:37:22 [DEBUG   ] spawn_process: at 2018-11-25 19:37:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:37:24 [DEBUG   ] Got command RPT from MCS: ref #625884
2018-11-25 19:37:24 [DEBUG   ] summary = ERROR
2018-11-25 19:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625884  13 58447 70644197 A  ERRORERROR'
2018-11-25 19:37:24 [DEBUG   ] Got command RPT from MCS: ref #625885
2018-11-25 19:37:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625885  77 58447 70644389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:37:24 [DEBUG   ] Got command RPT from MCS: ref #625886
2018-11-25 19:37:24 [DEBUG   ] summary = ERROR
2018-11-25 19:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625886  13 58447 70644593 A  ERRORERROR'
2018-11-25 19:37:24 [DEBUG   ] Got command RPT from MCS: ref #625887
2018-11-25 19:37:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625887  77 58447 70644797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:37:25 [DEBUG   ] Got command RPT from MCS: ref #625888
2018-11-25 19:37:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625888  12 58447 70645001 A  ERRORB£ff'
2018-11-25 19:37:32 [DEBUG   ] Got command BAM from MCS: ref #625889
2018-11-25 19:37:32 [INFO    ] Finished processing BAM request
2018-11-25 19:37:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625889   8 58447 70652025 A  ERROR'
2018-11-25 19:37:32 [DEBUG   ] Got command BAM from MCS: ref #625890
2018-11-25 19:37:32 [INFO    ] Finished processing BAM request
2018-11-25 19:37:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625890   8 58447 70652029 A  ERROR'
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:37:32 [DEBUG   ] spawn_process: at 2018-11-25 19:37:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:37:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:37:42 [DEBUG   ] Got command BAM from MCS: ref #625892
2018-11-25 19:37:42 [INFO    ] Finished processing BAM request
2018-11-25 19:37:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625892   8 58447 70662033 A  ERROR'
2018-11-25 19:37:42 [DEBUG   ] Got command BAM from MCS: ref #625891
2018-11-25 19:37:42 [INFO    ] Finished processing BAM request
2018-11-25 19:37:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625891   8 58447 70662037 A  ERROR'
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:37:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:37:42 [DEBUG   ] spawn_process: at 2018-11-25 19:37:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:37:52 [DEBUG   ] Got command BAM from MCS: ref #625894
2018-11-25 19:37:52 [INFO    ] Finished processing BAM request
2018-11-25 19:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625894   8 58447 70672025 A  ERROR'
2018-11-25 19:37:52 [DEBUG   ] Got command BAM from MCS: ref #625893
2018-11-25 19:37:52 [INFO    ] Finished processing BAM request
2018-11-25 19:37:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:37:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625893   8 58447 70672029 A  ERROR'
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:37:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:37:52 [DEBUG   ] spawn_process: at 2018-11-25 19:37:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:37:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 19:37:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:37:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:37:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:37:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:37:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:37:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:37:59 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-25 19:38:02 [DEBUG   ] Got command BAM from MCS: ref #625895
2018-11-25 19:38:02 [INFO    ] Finished processing BAM request
2018-11-25 19:38:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625895   8 58447 70682029 A  ERROR'
2018-11-25 19:38:02 [DEBUG   ] Got command BAM from MCS: ref #625896
2018-11-25 19:38:02 [INFO    ] Finished processing BAM request
2018-11-25 19:38:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625896   8 58447 70682033 A  ERROR'
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:38:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:38:02 [DEBUG   ] spawn_process: at 2018-11-25 19:38:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:38:12 [DEBUG   ] Got command BAM from MCS: ref #625898
2018-11-25 19:38:12 [INFO    ] Finished processing BAM request
2018-11-25 19:38:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625898   8 58447 70692033 A  ERROR'
2018-11-25 19:38:12 [DEBUG   ] Got command BAM from MCS: ref #625897
2018-11-25 19:38:12 [INFO    ] Finished processing BAM request
2018-11-25 19:38:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625897   8 58447 70692037 A  ERROR'
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:38:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:38:12 [DEBUG   ] spawn_process: at 2018-11-25 19:38:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:38:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:38:22 [DEBUG   ] Got command BAM from MCS: ref #625900
2018-11-25 19:38:22 [INFO    ] Finished processing BAM request
2018-11-25 19:38:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625900   8 58447 70702025 A  ERROR'
2018-11-25 19:38:22 [DEBUG   ] Got command BAM from MCS: ref #625899
2018-11-25 19:38:22 [INFO    ] Finished processing BAM request
2018-11-25 19:38:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625899   8 58447 70702029 A  ERROR'
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:38:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:38:22 [DEBUG   ] spawn_process: at 2018-11-25 19:38:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:38:32 [DEBUG   ] Got command BAM from MCS: ref #625901
2018-11-25 19:38:32 [INFO    ] Finished processing BAM request
2018-11-25 19:38:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625901   8 58447 70712029 A  ERROR'
2018-11-25 19:38:32 [DEBUG   ] Got command BAM from MCS: ref #625902
2018-11-25 19:38:32 [INFO    ] Finished processing BAM request
2018-11-25 19:38:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625902   8 58447 70712033 A  ERROR'
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:38:32 [DEBUG   ] spawn_process: at 2018-11-25 19:38:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:38:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:38:42 [DEBUG   ] Got command BAM from MCS: ref #625903
2018-11-25 19:38:42 [INFO    ] Finished processing BAM request
2018-11-25 19:38:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625903   8 58447 70722025 A  ERROR'
2018-11-25 19:38:42 [DEBUG   ] Got command BAM from MCS: ref #625904
2018-11-25 19:38:42 [INFO    ] Finished processing BAM request
2018-11-25 19:38:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625904   8 58447 70722029 A  ERROR'
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:38:42 [DEBUG   ] spawn_process: at 2018-11-25 19:38:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:38:52 [DEBUG   ] Got command BAM from MCS: ref #625905
2018-11-25 19:38:52 [INFO    ] Finished processing BAM request
2018-11-25 19:38:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625905   8 58447 70732029 A  ERROR'
2018-11-25 19:38:52 [DEBUG   ] Got command BAM from MCS: ref #625906
2018-11-25 19:38:52 [INFO    ] Finished processing BAM request
2018-11-25 19:38:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:38:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625906   8 58447 70732033 A  ERROR'
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:38:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:38:52 [DEBUG   ] spawn_process: at 2018-11-25 19:38:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:38:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 19:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:38:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:38:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:38:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:38:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:38:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:38:59 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-11-25 19:39:02 [DEBUG   ] Got command BAM from MCS: ref #625908
2018-11-25 19:39:02 [INFO    ] Finished processing BAM request
2018-11-25 19:39:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625908   8 58447 70742029 A  ERROR'
2018-11-25 19:39:02 [DEBUG   ] Got command BAM from MCS: ref #625907
2018-11-25 19:39:02 [INFO    ] Finished processing BAM request
2018-11-25 19:39:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625907   8 58447 70742033 A  ERROR'
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:39:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:39:02 [DEBUG   ] spawn_process: at 2018-11-25 19:39:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:39:12 [DEBUG   ] Got command BAM from MCS: ref #625909
2018-11-25 19:39:12 [INFO    ] Finished processing BAM request
2018-11-25 19:39:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625909   8 58447 70752033 A  ERROR'
2018-11-25 19:39:12 [DEBUG   ] Got command BAM from MCS: ref #625910
2018-11-25 19:39:12 [INFO    ] Finished processing BAM request
2018-11-25 19:39:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625910   8 58447 70752037 A  ERROR'
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:39:12 [DEBUG   ] spawn_process: at 2018-11-25 19:39:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:39:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:39:22 [DEBUG   ] Got command BAM from MCS: ref #625912
2018-11-25 19:39:22 [INFO    ] Finished processing BAM request
2018-11-25 19:39:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625912   8 58447 70762033 A  ERROR'
2018-11-25 19:39:22 [DEBUG   ] Got command BAM from MCS: ref #625911
2018-11-25 19:39:22 [INFO    ] Finished processing BAM request
2018-11-25 19:39:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625911   8 58447 70762037 A  ERROR'
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:39:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:39:22 [DEBUG   ] spawn_process: at 2018-11-25 19:39:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:39:32 [DEBUG   ] Got command BAM from MCS: ref #625913
2018-11-25 19:39:32 [INFO    ] Finished processing BAM request
2018-11-25 19:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625913   8 58447 70772025 A  ERROR'
2018-11-25 19:39:32 [DEBUG   ] Got command BAM from MCS: ref #625914
2018-11-25 19:39:32 [INFO    ] Finished processing BAM request
2018-11-25 19:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625914   8 58447 70772029 A  ERROR'
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:39:32 [DEBUG   ] spawn_process: at 2018-11-25 19:39:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:39:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:39:42 [DEBUG   ] Got command BAM from MCS: ref #625919
2018-11-25 19:39:42 [INFO    ] Finished processing BAM request
2018-11-25 19:39:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625919   8 58447 70782029 A  ERROR'
2018-11-25 19:39:42 [DEBUG   ] Got command BAM from MCS: ref #625920
2018-11-25 19:39:42 [INFO    ] Finished processing BAM request
2018-11-25 19:39:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625920   8 58447 70782033 A  ERROR'
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:39:42 [DEBUG   ] spawn_process: at 2018-11-25 19:39:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:39:52 [DEBUG   ] Got command BAM from MCS: ref #625921
2018-11-25 19:39:52 [INFO    ] Finished processing BAM request
2018-11-25 19:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625921   8 58447 70792033 A  ERROR'
2018-11-25 19:39:52 [DEBUG   ] Got command BAM from MCS: ref #625922
2018-11-25 19:39:52 [INFO    ] Finished processing BAM request
2018-11-25 19:39:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625922   8 58447 70792037 A  ERROR'
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:39:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:39:52 [DEBUG   ] spawn_process: at 2018-11-25 19:39:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:39:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:39:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:39:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:39:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:39:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:39:59 [WARNING ] (13, 1, 'bot')
2018-11-25 19:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:39:59 [DEBUG   ] Finished updating board flags in 0.963 seconds
2018-11-25 19:40:02 [DEBUG   ] Got command BAM from MCS: ref #625923
2018-11-25 19:40:02 [INFO    ] Finished processing BAM request
2018-11-25 19:40:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625923   8 58447 70802029 A  ERROR'
2018-11-25 19:40:02 [DEBUG   ] Got command BAM from MCS: ref #625924
2018-11-25 19:40:02 [INFO    ] Finished processing BAM request
2018-11-25 19:40:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625924   8 58447 70802033 A  ERROR'
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:40:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:40:02 [DEBUG   ] spawn_process: at 2018-11-25 19:40:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:40:12 [DEBUG   ] Got command BAM from MCS: ref #625925
2018-11-25 19:40:12 [INFO    ] Finished processing BAM request
2018-11-25 19:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625925   8 58447 70812029 A  ERROR'
2018-11-25 19:40:12 [DEBUG   ] Got command BAM from MCS: ref #625926
2018-11-25 19:40:12 [INFO    ] Finished processing BAM request
2018-11-25 19:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625926   8 58447 70812033 A  ERROR'
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:40:12 [DEBUG   ] spawn_process: at 2018-11-25 19:40:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:40:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:40:22 [DEBUG   ] Got command BAM from MCS: ref #625928
2018-11-25 19:40:22 [INFO    ] Finished processing BAM request
2018-11-25 19:40:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625928   8 58447 70822029 A  ERROR'
2018-11-25 19:40:22 [DEBUG   ] Got command BAM from MCS: ref #625927
2018-11-25 19:40:22 [INFO    ] Finished processing BAM request
2018-11-25 19:40:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625927   8 58447 70822033 A  ERROR'
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:40:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:40:22 [DEBUG   ] spawn_process: at 2018-11-25 19:40:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:40:32 [DEBUG   ] Got command BAM from MCS: ref #625930
2018-11-25 19:40:32 [INFO    ] Finished processing BAM request
2018-11-25 19:40:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625930   8 58447 70832025 A  ERROR'
2018-11-25 19:40:32 [DEBUG   ] Got command BAM from MCS: ref #625929
2018-11-25 19:40:32 [INFO    ] Finished processing BAM request
2018-11-25 19:40:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625929   8 58447 70832029 A  ERROR'
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:40:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:40:32 [DEBUG   ] spawn_process: at 2018-11-25 19:40:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:40:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:40:42 [DEBUG   ] Got command BAM from MCS: ref #625932
2018-11-25 19:40:42 [INFO    ] Finished processing BAM request
2018-11-25 19:40:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625932   8 58447 70842033 A  ERROR'
2018-11-25 19:40:42 [DEBUG   ] Got command BAM from MCS: ref #625931
2018-11-25 19:40:42 [INFO    ] Finished processing BAM request
2018-11-25 19:40:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625931   8 58447 70842037 A  ERROR'
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:40:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:40:42 [DEBUG   ] spawn_process: at 2018-11-25 19:40:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:40:48 [DEBUG   ] Got command RPT from MCS: ref #625933
2018-11-25 19:40:48 [DEBUG   ] summary = ERROR
2018-11-25 19:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625933  13 58447 70848485 A  ERRORERROR'
2018-11-25 19:40:48 [DEBUG   ] Got command RPT from MCS: ref #625934
2018-11-25 19:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625934  77 58447 70848486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:40:52 [DEBUG   ] Got command BAM from MCS: ref #625950
2018-11-25 19:40:52 [INFO    ] Finished processing BAM request
2018-11-25 19:40:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625950   8 58447 70852033 A  ERROR'
2018-11-25 19:40:52 [DEBUG   ] Got command BAM from MCS: ref #625951
2018-11-25 19:40:52 [INFO    ] Finished processing BAM request
2018-11-25 19:40:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:40:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625951   8 58447 70852037 A  ERROR'
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:40:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:40:52 [DEBUG   ] spawn_process: at 2018-11-25 19:40:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:40:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-25 19:41:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:41:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:41:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:41:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:41:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:41:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:41:00 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-11-25 19:41:02 [DEBUG   ] Got command BAM from MCS: ref #625952
2018-11-25 19:41:02 [INFO    ] Finished processing BAM request
2018-11-25 19:41:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625952   8 58447 70862025 A  ERROR'
2018-11-25 19:41:02 [DEBUG   ] Got command BAM from MCS: ref #625953
2018-11-25 19:41:02 [INFO    ] Finished processing BAM request
2018-11-25 19:41:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625953   8 58447 70862029 A  ERROR'
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:41:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:41:02 [DEBUG   ] spawn_process: at 2018-11-25 19:41:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:41:12 [DEBUG   ] Got command BAM from MCS: ref #625954
2018-11-25 19:41:12 [INFO    ] Finished processing BAM request
2018-11-25 19:41:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625954   8 58447 70872033 A  ERROR'
2018-11-25 19:41:12 [DEBUG   ] Got command BAM from MCS: ref #625955
2018-11-25 19:41:12 [INFO    ] Finished processing BAM request
2018-11-25 19:41:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625955   8 58447 70872037 A  ERROR'
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:41:12 [DEBUG   ] spawn_process: at 2018-11-25 19:41:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:41:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:41:22 [DEBUG   ] Got command BAM from MCS: ref #625957
2018-11-25 19:41:22 [INFO    ] Finished processing BAM request
2018-11-25 19:41:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625957   8 58447 70882025 A  ERROR'
2018-11-25 19:41:22 [DEBUG   ] Got command BAM from MCS: ref #625956
2018-11-25 19:41:22 [INFO    ] Finished processing BAM request
2018-11-25 19:41:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625956   8 58447 70882029 A  ERROR'
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:41:22 [DEBUG   ] spawn_process: at 2018-11-25 19:41:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:41:32 [DEBUG   ] Got command BAM from MCS: ref #625959
2018-11-25 19:41:32 [INFO    ] Finished processing BAM request
2018-11-25 19:41:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625959   8 58447 70892029 A  ERROR'
2018-11-25 19:41:32 [DEBUG   ] Got command BAM from MCS: ref #625958
2018-11-25 19:41:32 [INFO    ] Finished processing BAM request
2018-11-25 19:41:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625958   8 58447 70892033 A  ERROR'
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:41:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:41:32 [DEBUG   ] spawn_process: at 2018-11-25 19:41:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:41:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:41:42 [DEBUG   ] Got command BAM from MCS: ref #625960
2018-11-25 19:41:42 [INFO    ] Finished processing BAM request
2018-11-25 19:41:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625960   8 58447 70902033 A  ERROR'
2018-11-25 19:41:42 [DEBUG   ] Got command BAM from MCS: ref #625961
2018-11-25 19:41:42 [INFO    ] Finished processing BAM request
2018-11-25 19:41:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625961   8 58447 70902037 A  ERROR'
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:41:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:41:42 [DEBUG   ] spawn_process: at 2018-11-25 19:41:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:41:52 [DEBUG   ] Got command BAM from MCS: ref #625962
2018-11-25 19:41:52 [INFO    ] Finished processing BAM request
2018-11-25 19:41:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625962   8 58447 70912029 A  ERROR'
2018-11-25 19:41:52 [DEBUG   ] Got command BAM from MCS: ref #625963
2018-11-25 19:41:52 [INFO    ] Finished processing BAM request
2018-11-25 19:41:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625963   8 58447 70912033 A  ERROR'
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:41:52 [DEBUG   ] spawn_process: at 2018-11-25 19:41:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:41:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 19:42:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:42:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:42:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:42:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:42:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:42:00 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-11-25 19:42:02 [DEBUG   ] Got command BAM from MCS: ref #625965
2018-11-25 19:42:02 [INFO    ] Finished processing BAM request
2018-11-25 19:42:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625965   8 58447 70922033 A  ERROR'
2018-11-25 19:42:02 [DEBUG   ] Got command BAM from MCS: ref #625964
2018-11-25 19:42:02 [INFO    ] Finished processing BAM request
2018-11-25 19:42:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625964   8 58447 70922037 A  ERROR'
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:42:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:42:02 [DEBUG   ] spawn_process: at 2018-11-25 19:42:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:42:12 [DEBUG   ] Got command BAM from MCS: ref #625969
2018-11-25 19:42:12 [INFO    ] Finished processing BAM request
2018-11-25 19:42:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625969   8 58447 70932025 A  ERROR'
2018-11-25 19:42:12 [DEBUG   ] Got command BAM from MCS: ref #625968
2018-11-25 19:42:12 [INFO    ] Finished processing BAM request
2018-11-25 19:42:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625968   8 58447 70932029 A  ERROR'
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:42:12 [DEBUG   ] spawn_process: at 2018-11-25 19:42:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:42:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:42:22 [DEBUG   ] Got command BAM from MCS: ref #625971
2018-11-25 19:42:22 [INFO    ] Finished processing BAM request
2018-11-25 19:42:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625971   8 58447 70942033 A  ERROR'
2018-11-25 19:42:22 [DEBUG   ] Got command BAM from MCS: ref #625970
2018-11-25 19:42:22 [INFO    ] Finished processing BAM request
2018-11-25 19:42:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625970   8 58447 70942037 A  ERROR'
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:42:22 [DEBUG   ] spawn_process: at 2018-11-25 19:42:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:42:24 [DEBUG   ] Got command RPT from MCS: ref #625972
2018-11-25 19:42:24 [DEBUG   ] summary = ERROR
2018-11-25 19:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625972  13 58447 70944281 A  ERRORERROR'
2018-11-25 19:42:24 [DEBUG   ] Got command RPT from MCS: ref #625973
2018-11-25 19:42:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625973  77 58447 70944485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:42:24 [DEBUG   ] Got command RPT from MCS: ref #625974
2018-11-25 19:42:24 [DEBUG   ] summary = ERROR
2018-11-25 19:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625974  13 58447 70944677 A  ERRORERROR'
2018-11-25 19:42:24 [DEBUG   ] Got command RPT from MCS: ref #625976
2018-11-25 19:42:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625976  77 58447 70944881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:42:25 [DEBUG   ] Got command RPT from MCS: ref #625977
2018-11-25 19:42:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   625977  12 58447 70945085 A  ERRORB¢ff'
2018-11-25 19:42:32 [DEBUG   ] Got command BAM from MCS: ref #625983
2018-11-25 19:42:32 [INFO    ] Finished processing BAM request
2018-11-25 19:42:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625983   8 58447 70952025 A  ERROR'
2018-11-25 19:42:32 [DEBUG   ] Got command BAM from MCS: ref #625982
2018-11-25 19:42:32 [INFO    ] Finished processing BAM request
2018-11-25 19:42:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625982   8 58447 70952029 A  ERROR'
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:42:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:42:32 [DEBUG   ] spawn_process: at 2018-11-25 19:42:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:42:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:42:42 [DEBUG   ] Got command BAM from MCS: ref #625989
2018-11-25 19:42:42 [INFO    ] Finished processing BAM request
2018-11-25 19:42:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625989   8 58447 70962029 A  ERROR'
2018-11-25 19:42:42 [DEBUG   ] Got command BAM from MCS: ref #625988
2018-11-25 19:42:42 [INFO    ] Finished processing BAM request
2018-11-25 19:42:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625988   8 58447 70962033 A  ERROR'
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:42:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:42:42 [DEBUG   ] spawn_process: at 2018-11-25 19:42:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:42:52 [DEBUG   ] Got command BAM from MCS: ref #625990
2018-11-25 19:42:52 [INFO    ] Finished processing BAM request
2018-11-25 19:42:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625990   8 58447 70972033 A  ERROR'
2018-11-25 19:42:52 [DEBUG   ] Got command BAM from MCS: ref #625991
2018-11-25 19:42:52 [INFO    ] Finished processing BAM request
2018-11-25 19:42:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:42:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625991   8 58447 70972037 A  ERROR'
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:42:52 [DEBUG   ] spawn_process: at 2018-11-25 19:42:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:42:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 19:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 19:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:43:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:43:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:43:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:43:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:43:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:43:00 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-25 19:43:02 [DEBUG   ] Got command BAM from MCS: ref #625992
2018-11-25 19:43:02 [INFO    ] Finished processing BAM request
2018-11-25 19:43:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625992   8 58447 70982033 A  ERROR'
2018-11-25 19:43:02 [DEBUG   ] Got command BAM from MCS: ref #625993
2018-11-25 19:43:02 [INFO    ] Finished processing BAM request
2018-11-25 19:43:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625993   8 58447 70982037 A  ERROR'
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:43:02 [DEBUG   ] spawn_process: at 2018-11-25 19:43:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:43:12 [DEBUG   ] Got command BAM from MCS: ref #625995
2018-11-25 19:43:12 [INFO    ] Finished processing BAM request
2018-11-25 19:43:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625995   8 58447 70992025 A  ERROR'
2018-11-25 19:43:12 [DEBUG   ] Got command BAM from MCS: ref #625994
2018-11-25 19:43:12 [INFO    ] Finished processing BAM request
2018-11-25 19:43:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625994   8 58447 70992029 A  ERROR'
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:43:12 [DEBUG   ] spawn_process: at 2018-11-25 19:43:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:43:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 19:43:22 [DEBUG   ] Got command BAM from MCS: ref #625996
2018-11-25 19:43:22 [INFO    ] Finished processing BAM request
2018-11-25 19:43:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625996   8 58447 71002025 A  ERROR'
2018-11-25 19:43:22 [DEBUG   ] Got command BAM from MCS: ref #625997
2018-11-25 19:43:22 [INFO    ] Finished processing BAM request
2018-11-25 19:43:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625997   8 58447 71002029 A  ERROR'
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:43:22 [DEBUG   ] spawn_process: at 2018-11-25 19:43:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:43:32 [DEBUG   ] Got command BAM from MCS: ref #625999
2018-11-25 19:43:32 [INFO    ] Finished processing BAM request
2018-11-25 19:43:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625999   8 58447 71012033 A  ERROR'
2018-11-25 19:43:32 [DEBUG   ] Got command BAM from MCS: ref #625998
2018-11-25 19:43:32 [INFO    ] Finished processing BAM request
2018-11-25 19:43:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   625998   8 58447 71012037 A  ERROR'
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:43:32 [DEBUG   ] spawn_process: at 2018-11-25 19:43:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:43:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:43:42 [DEBUG   ] Got command BAM from MCS: ref #626000
2018-11-25 19:43:42 [INFO    ] Finished processing BAM request
2018-11-25 19:43:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626000   8 58447 71022033 A  ERROR'
2018-11-25 19:43:42 [DEBUG   ] Got command BAM from MCS: ref #626001
2018-11-25 19:43:42 [INFO    ] Finished processing BAM request
2018-11-25 19:43:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626001   8 58447 71022037 A  ERROR'
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:43:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:43:42 [DEBUG   ] spawn_process: at 2018-11-25 19:43:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:43:52 [DEBUG   ] Got command BAM from MCS: ref #626003
2018-11-25 19:43:52 [INFO    ] Finished processing BAM request
2018-11-25 19:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626003   8 58447 71032025 A  ERROR'
2018-11-25 19:43:52 [DEBUG   ] Got command BAM from MCS: ref #626002
2018-11-25 19:43:52 [INFO    ] Finished processing BAM request
2018-11-25 19:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626002   8 58447 71032029 A  ERROR'
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:43:52 [DEBUG   ] spawn_process: at 2018-11-25 19:43:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:43:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:44:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:44:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:44:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:44:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:44:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:44:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:44:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:44:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:44:01 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-11-25 19:44:03 [DEBUG   ] Got command BAM from MCS: ref #626004
2018-11-25 19:44:03 [INFO    ] Finished processing BAM request
2018-11-25 19:44:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626004   8 58447 71043025 A  ERROR'
2018-11-25 19:44:03 [DEBUG   ] Got command BAM from MCS: ref #626005
2018-11-25 19:44:03 [INFO    ] Finished processing BAM request
2018-11-25 19:44:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626005   8 58447 71043029 A  ERROR'
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:44:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:44:03 [DEBUG   ] spawn_process: at 2018-11-25 19:44:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:44:14 [DEBUG   ] Got command BAM from MCS: ref #626007
2018-11-25 19:44:14 [INFO    ] Finished processing BAM request
2018-11-25 19:44:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626007   8 58447 71054033 A  ERROR'
2018-11-25 19:44:14 [DEBUG   ] Got command BAM from MCS: ref #626006
2018-11-25 19:44:14 [INFO    ] Finished processing BAM request
2018-11-25 19:44:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626006   8 58447 71054037 A  ERROR'
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:44:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:44:14 [DEBUG   ] spawn_process: at 2018-11-25 19:44:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:44:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:44:25 [DEBUG   ] Got command BAM from MCS: ref #626009
2018-11-25 19:44:25 [INFO    ] Finished processing BAM request
2018-11-25 19:44:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626009   8 58447 71065029 A  ERROR'
2018-11-25 19:44:25 [DEBUG   ] Got command BAM from MCS: ref #626008
2018-11-25 19:44:25 [INFO    ] Finished processing BAM request
2018-11-25 19:44:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626008   8 58447 71065033 A  ERROR'
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:44:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:44:25 [DEBUG   ] spawn_process: at 2018-11-25 19:44:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:44:36 [DEBUG   ] Got command BAM from MCS: ref #626010
2018-11-25 19:44:36 [INFO    ] Finished processing BAM request
2018-11-25 19:44:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626010   8 58447 71076029 A  ERROR'
2018-11-25 19:44:36 [DEBUG   ] Got command BAM from MCS: ref #626011
2018-11-25 19:44:36 [INFO    ] Finished processing BAM request
2018-11-25 19:44:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626011   8 58447 71076033 A  ERROR'
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:44:36 [DEBUG   ] spawn_process: at 2018-11-25 19:44:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:44:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:44:47 [DEBUG   ] Got command BAM from MCS: ref #626012
2018-11-25 19:44:47 [INFO    ] Finished processing BAM request
2018-11-25 19:44:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626012   8 58447 71087029 A  ERROR'
2018-11-25 19:44:47 [DEBUG   ] Got command BAM from MCS: ref #626013
2018-11-25 19:44:47 [INFO    ] Finished processing BAM request
2018-11-25 19:44:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626013   8 58447 71087033 A  ERROR'
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:44:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:44:47 [DEBUG   ] spawn_process: at 2018-11-25 19:44:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:44:58 [DEBUG   ] Got command BAM from MCS: ref #626015
2018-11-25 19:44:58 [INFO    ] Finished processing BAM request
2018-11-25 19:44:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626015   8 58447 71098029 A  ERROR'
2018-11-25 19:44:58 [DEBUG   ] Got command BAM from MCS: ref #626014
2018-11-25 19:44:58 [INFO    ] Finished processing BAM request
2018-11-25 19:44:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626014   8 58447 71098033 A  ERROR'
2018-11-25 19:44:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:44:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:44:58 [DEBUG   ] spawn_process: at 2018-11-25 19:44:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 19:45:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 19:45:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:45:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:45:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:45:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:45:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:45:00 [DEBUG   ] Finished updating board flags in 0.978 seconds
2018-11-25 19:45:09 [DEBUG   ] Got command BAM from MCS: ref #626017
2018-11-25 19:45:09 [INFO    ] Finished processing BAM request
2018-11-25 19:45:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626017   8 58447 71109041 A  ERROR'
2018-11-25 19:45:09 [DEBUG   ] Got command BAM from MCS: ref #626016
2018-11-25 19:45:09 [INFO    ] Finished processing BAM request
2018-11-25 19:45:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626016   8 58447 71109045 A  ERROR'
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:45:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:45:09 [DEBUG   ] spawn_process: at 2018-11-25 19:45:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:45:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:45:20 [DEBUG   ] Got command BAM from MCS: ref #626019
2018-11-25 19:45:20 [INFO    ] Finished processing BAM request
2018-11-25 19:45:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626019   8 58447 71120037 A  ERROR'
2018-11-25 19:45:20 [DEBUG   ] Got command BAM from MCS: ref #626018
2018-11-25 19:45:20 [INFO    ] Finished processing BAM request
2018-11-25 19:45:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626018   8 58447 71120041 A  ERROR'
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:45:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:45:20 [DEBUG   ] spawn_process: at 2018-11-25 19:45:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:45:31 [DEBUG   ] Got command BAM from MCS: ref #626020
2018-11-25 19:45:31 [INFO    ] Finished processing BAM request
2018-11-25 19:45:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626020   8 58447 71131025 A  ERROR'
2018-11-25 19:45:31 [DEBUG   ] Got command BAM from MCS: ref #626021
2018-11-25 19:45:31 [INFO    ] Finished processing BAM request
2018-11-25 19:45:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626021   8 58447 71131029 A  ERROR'
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:45:31 [DEBUG   ] spawn_process: at 2018-11-25 19:45:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:45:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:45:42 [DEBUG   ] Got command BAM from MCS: ref #626026
2018-11-25 19:45:42 [INFO    ] Finished processing BAM request
2018-11-25 19:45:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626026   8 58447 71142025 A  ERROR'
2018-11-25 19:45:42 [DEBUG   ] Got command BAM from MCS: ref #626027
2018-11-25 19:45:42 [INFO    ] Finished processing BAM request
2018-11-25 19:45:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626027   8 58447 71142029 A  ERROR'
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:45:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:45:42 [DEBUG   ] spawn_process: at 2018-11-25 19:45:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:45:48 [DEBUG   ] Got command RPT from MCS: ref #626028
2018-11-25 19:45:48 [DEBUG   ] summary = ERROR
2018-11-25 19:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626028  13 58447 71148485 A  ERRORERROR'
2018-11-25 19:45:48 [DEBUG   ] Got command RPT from MCS: ref #626029
2018-11-25 19:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626029  77 58447 71148486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:45:53 [DEBUG   ] Got command BAM from MCS: ref #626046
2018-11-25 19:45:53 [INFO    ] Finished processing BAM request
2018-11-25 19:45:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626046   8 58447 71153025 A  ERROR'
2018-11-25 19:45:53 [DEBUG   ] Got command BAM from MCS: ref #626045
2018-11-25 19:45:53 [INFO    ] Finished processing BAM request
2018-11-25 19:45:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:45:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626045   8 58447 71153029 A  ERROR'
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:45:53 [DEBUG   ] spawn_process: at 2018-11-25 19:45:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:45:58 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-25 19:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:46:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:46:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:46:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:46:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:46:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:46:00 [DEBUG   ] Finished updating board flags in 1.270 seconds
2018-11-25 19:46:04 [DEBUG   ] Got command BAM from MCS: ref #626047
2018-11-25 19:46:04 [INFO    ] Finished processing BAM request
2018-11-25 19:46:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626047   8 58447 71164033 A  ERROR'
2018-11-25 19:46:04 [DEBUG   ] Got command BAM from MCS: ref #626048
2018-11-25 19:46:04 [INFO    ] Finished processing BAM request
2018-11-25 19:46:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626048   8 58447 71164037 A  ERROR'
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:46:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:46:04 [DEBUG   ] spawn_process: at 2018-11-25 19:46:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:46:15 [DEBUG   ] Got command BAM from MCS: ref #626049
2018-11-25 19:46:15 [INFO    ] Finished processing BAM request
2018-11-25 19:46:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626049   8 58447 71175025 A  ERROR'
2018-11-25 19:46:15 [DEBUG   ] Got command BAM from MCS: ref #626050
2018-11-25 19:46:15 [INFO    ] Finished processing BAM request
2018-11-25 19:46:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626050   8 58447 71175029 A  ERROR'
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:46:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:46:15 [DEBUG   ] spawn_process: at 2018-11-25 19:46:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:46:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:46:26 [DEBUG   ] Got command BAM from MCS: ref #626052
2018-11-25 19:46:26 [INFO    ] Finished processing BAM request
2018-11-25 19:46:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626052   8 58447 71186025 A  ERROR'
2018-11-25 19:46:26 [DEBUG   ] Got command BAM from MCS: ref #626051
2018-11-25 19:46:26 [INFO    ] Finished processing BAM request
2018-11-25 19:46:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626051   8 58447 71186029 A  ERROR'
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:46:26 [DEBUG   ] spawn_process: at 2018-11-25 19:46:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:46:37 [DEBUG   ] Got command BAM from MCS: ref #626054
2018-11-25 19:46:37 [INFO    ] Finished processing BAM request
2018-11-25 19:46:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626054   8 58447 71197033 A  ERROR'
2018-11-25 19:46:37 [DEBUG   ] Got command BAM from MCS: ref #626053
2018-11-25 19:46:37 [INFO    ] Finished processing BAM request
2018-11-25 19:46:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626053   8 58447 71197037 A  ERROR'
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:46:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:46:37 [DEBUG   ] spawn_process: at 2018-11-25 19:46:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:46:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 19:46:48 [DEBUG   ] Got command BAM from MCS: ref #626055
2018-11-25 19:46:48 [INFO    ] Finished processing BAM request
2018-11-25 19:46:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626055   8 58447 71208033 A  ERROR'
2018-11-25 19:46:48 [DEBUG   ] Got command BAM from MCS: ref #626056
2018-11-25 19:46:48 [INFO    ] Finished processing BAM request
2018-11-25 19:46:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626056   8 58447 71208037 A  ERROR'
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:46:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:46:48 [DEBUG   ] spawn_process: at 2018-11-25 19:46:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:46:59 [DEBUG   ] Got command BAM from MCS: ref #626057
2018-11-25 19:46:59 [INFO    ] Finished processing BAM request
2018-11-25 19:46:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626057   8 58447 71219037 A  ERROR'
2018-11-25 19:46:59 [DEBUG   ] Got command BAM from MCS: ref #626058
2018-11-25 19:46:59 [INFO    ] Finished processing BAM request
2018-11-25 19:46:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626058   8 58447 71219045 A  ERROR'
2018-11-25 19:46:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:46:59 [DEBUG   ] spawn_process: at 2018-11-25 19:46:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 19:47:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:47:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:47:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:47:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:47:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:47:00 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-25 19:47:10 [DEBUG   ] Got command BAM from MCS: ref #626060
2018-11-25 19:47:10 [INFO    ] Finished processing BAM request
2018-11-25 19:47:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626060   8 58447 71230037 A  ERROR'
2018-11-25 19:47:10 [DEBUG   ] Got command BAM from MCS: ref #626059
2018-11-25 19:47:10 [INFO    ] Finished processing BAM request
2018-11-25 19:47:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626059   8 58447 71230041 A  ERROR'
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:47:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:47:10 [DEBUG   ] spawn_process: at 2018-11-25 19:47:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:47:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:47:21 [DEBUG   ] Got command BAM from MCS: ref #626062
2018-11-25 19:47:21 [INFO    ] Finished processing BAM request
2018-11-25 19:47:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626062   8 58447 71241033 A  ERROR'
2018-11-25 19:47:21 [DEBUG   ] Got command BAM from MCS: ref #626061
2018-11-25 19:47:21 [INFO    ] Finished processing BAM request
2018-11-25 19:47:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626061   8 58447 71241037 A  ERROR'
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:47:21 [DEBUG   ] spawn_process: at 2018-11-25 19:47:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:47:24 [DEBUG   ] Got command RPT from MCS: ref #626063
2018-11-25 19:47:24 [DEBUG   ] summary = ERROR
2018-11-25 19:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626063  13 58447 71244373 A  ERRORERROR'
2018-11-25 19:47:24 [DEBUG   ] Got command RPT from MCS: ref #626064
2018-11-25 19:47:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626064  77 58447 71244565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:47:24 [DEBUG   ] Got command RPT from MCS: ref #626065
2018-11-25 19:47:24 [DEBUG   ] summary = ERROR
2018-11-25 19:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626065  13 58447 71244769 A  ERRORERROR'
2018-11-25 19:47:24 [DEBUG   ] Got command RPT from MCS: ref #626066
2018-11-25 19:47:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626066  77 58447 71244973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:47:25 [DEBUG   ] Got command RPT from MCS: ref #626067
2018-11-25 19:47:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626067  12 58447 71245165 A  ERRORB¢ff'
2018-11-25 19:47:32 [DEBUG   ] Got command BAM from MCS: ref #626068
2018-11-25 19:47:32 [INFO    ] Finished processing BAM request
2018-11-25 19:47:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626068   8 58447 71252033 A  ERROR'
2018-11-25 19:47:32 [DEBUG   ] Got command BAM from MCS: ref #626069
2018-11-25 19:47:32 [INFO    ] Finished processing BAM request
2018-11-25 19:47:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626069   8 58447 71252037 A  ERROR'
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:47:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:47:32 [DEBUG   ] spawn_process: at 2018-11-25 19:47:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:47:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 19:47:43 [DEBUG   ] Got command BAM from MCS: ref #626071
2018-11-25 19:47:43 [INFO    ] Finished processing BAM request
2018-11-25 19:47:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626071   8 58447 71263033 A  ERROR'
2018-11-25 19:47:43 [DEBUG   ] Got command BAM from MCS: ref #626070
2018-11-25 19:47:43 [INFO    ] Finished processing BAM request
2018-11-25 19:47:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626070   8 58447 71263037 A  ERROR'
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:47:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:47:43 [DEBUG   ] spawn_process: at 2018-11-25 19:47:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:47:54 [DEBUG   ] Got command BAM from MCS: ref #626073
2018-11-25 19:47:54 [INFO    ] Finished processing BAM request
2018-11-25 19:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626073   8 58447 71274033 A  ERROR'
2018-11-25 19:47:54 [DEBUG   ] Got command BAM from MCS: ref #626072
2018-11-25 19:47:54 [INFO    ] Finished processing BAM request
2018-11-25 19:47:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:47:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626072   8 58447 71274037 A  ERROR'
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:47:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:47:54 [DEBUG   ] spawn_process: at 2018-11-25 19:47:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:47:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 19:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-25 19:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-25 19:48:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 19:48:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:48:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:48:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:48:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:48:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:48:00 [DEBUG   ] Finished updating board flags in 1.167 seconds
2018-11-25 19:48:05 [DEBUG   ] Got command BAM from MCS: ref #626075
2018-11-25 19:48:05 [INFO    ] Finished processing BAM request
2018-11-25 19:48:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626075   8 58447 71285029 A  ERROR'
2018-11-25 19:48:05 [DEBUG   ] Got command BAM from MCS: ref #626074
2018-11-25 19:48:05 [INFO    ] Finished processing BAM request
2018-11-25 19:48:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626074   8 58447 71285033 A  ERROR'
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:48:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:48:05 [DEBUG   ] spawn_process: at 2018-11-25 19:48:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:48:16 [DEBUG   ] Got command BAM from MCS: ref #626076
2018-11-25 19:48:16 [INFO    ] Finished processing BAM request
2018-11-25 19:48:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626076   8 58447 71296033 A  ERROR'
2018-11-25 19:48:16 [DEBUG   ] Got command BAM from MCS: ref #626077
2018-11-25 19:48:16 [INFO    ] Finished processing BAM request
2018-11-25 19:48:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626077   8 58447 71296037 A  ERROR'
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:48:16 [DEBUG   ] spawn_process: at 2018-11-25 19:48:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:48:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 19:48:27 [DEBUG   ] Got command BAM from MCS: ref #626079
2018-11-25 19:48:27 [INFO    ] Finished processing BAM request
2018-11-25 19:48:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626079   8 58447 71307025 A  ERROR'
2018-11-25 19:48:27 [DEBUG   ] Got command BAM from MCS: ref #626078
2018-11-25 19:48:27 [INFO    ] Finished processing BAM request
2018-11-25 19:48:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626078   8 58447 71307029 A  ERROR'
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:48:27 [DEBUG   ] spawn_process: at 2018-11-25 19:48:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:48:38 [DEBUG   ] Got command BAM from MCS: ref #626085
2018-11-25 19:48:38 [INFO    ] Finished processing BAM request
2018-11-25 19:48:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626085   8 58447 71318025 A  ERROR'
2018-11-25 19:48:38 [DEBUG   ] Got command BAM from MCS: ref #626084
2018-11-25 19:48:38 [INFO    ] Finished processing BAM request
2018-11-25 19:48:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626084   8 58447 71318029 A  ERROR'
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:48:38 [DEBUG   ] spawn_process: at 2018-11-25 19:48:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:48:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 19:48:49 [DEBUG   ] Got command BAM from MCS: ref #626086
2018-11-25 19:48:49 [INFO    ] Finished processing BAM request
2018-11-25 19:48:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626086   8 58447 71329025 A  ERROR'
2018-11-25 19:48:49 [DEBUG   ] Got command BAM from MCS: ref #626087
2018-11-25 19:48:49 [INFO    ] Finished processing BAM request
2018-11-25 19:48:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:48:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626087   8 58447 71329029 A  ERROR'
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:48:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:48:49 [DEBUG   ] spawn_process: at 2018-11-25 19:48:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:48:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:49:00 [DEBUG   ] Got command BAM from MCS: ref #626088
2018-11-25 19:49:00 [INFO    ] Finished processing BAM request
2018-11-25 19:49:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626088   8 58447 71340033 A  ERROR'
2018-11-25 19:49:00 [DEBUG   ] Got command BAM from MCS: ref #626089
2018-11-25 19:49:00 [INFO    ] Finished processing BAM request
2018-11-25 19:49:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626089   8 58447 71340037 A  ERROR'
2018-11-25 19:49:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 19:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:49:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:49:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:49:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:49:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:49:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:49:00 [DEBUG   ] Finished updating board flags in 1.048 seconds
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:49:00 [DEBUG   ] spawn_process: at 2018-11-25 19:49:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:49:11 [DEBUG   ] Got command BAM from MCS: ref #626090
2018-11-25 19:49:11 [INFO    ] Finished processing BAM request
2018-11-25 19:49:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626090   8 58447 71351025 A  ERROR'
2018-11-25 19:49:11 [DEBUG   ] Got command BAM from MCS: ref #626091
2018-11-25 19:49:11 [INFO    ] Finished processing BAM request
2018-11-25 19:49:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626091   8 58447 71351029 A  ERROR'
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:49:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:49:11 [DEBUG   ] spawn_process: at 2018-11-25 19:49:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:49:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:49:22 [DEBUG   ] Got command BAM from MCS: ref #626093
2018-11-25 19:49:22 [INFO    ] Finished processing BAM request
2018-11-25 19:49:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626093   8 58447 71362025 A  ERROR'
2018-11-25 19:49:22 [DEBUG   ] Got command BAM from MCS: ref #626092
2018-11-25 19:49:22 [INFO    ] Finished processing BAM request
2018-11-25 19:49:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626092   8 58447 71362029 A  ERROR'
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:49:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:49:22 [DEBUG   ] spawn_process: at 2018-11-25 19:49:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:49:33 [DEBUG   ] Got command BAM from MCS: ref #626095
2018-11-25 19:49:33 [INFO    ] Finished processing BAM request
2018-11-25 19:49:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626095   8 58447 71373025 A  ERROR'
2018-11-25 19:49:33 [DEBUG   ] Got command BAM from MCS: ref #626094
2018-11-25 19:49:33 [INFO    ] Finished processing BAM request
2018-11-25 19:49:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626094   8 58447 71373029 A  ERROR'
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:49:33 [DEBUG   ] spawn_process: at 2018-11-25 19:49:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:49:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:49:44 [DEBUG   ] Got command BAM from MCS: ref #626096
2018-11-25 19:49:44 [INFO    ] Finished processing BAM request
2018-11-25 19:49:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626096   8 58447 71384033 A  ERROR'
2018-11-25 19:49:44 [DEBUG   ] Got command BAM from MCS: ref #626097
2018-11-25 19:49:44 [INFO    ] Finished processing BAM request
2018-11-25 19:49:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626097   8 58447 71384037 A  ERROR'
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:49:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:49:44 [DEBUG   ] spawn_process: at 2018-11-25 19:49:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:49:55 [DEBUG   ] Got command BAM from MCS: ref #626098
2018-11-25 19:49:55 [INFO    ] Finished processing BAM request
2018-11-25 19:49:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626098   8 58447 71395053 A  ERROR'
2018-11-25 19:49:55 [DEBUG   ] Got command BAM from MCS: ref #626099
2018-11-25 19:49:55 [INFO    ] Finished processing BAM request
2018-11-25 19:49:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626099   8 58447 71395057 A  ERROR'
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:49:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:49:55 [DEBUG   ] spawn_process: at 2018-11-25 19:49:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:49:59 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-25 19:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 19:50:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:50:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:50:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:50:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:50:00 [WARNING ] (13, 1, 'bot')
2018-11-25 19:50:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:50:00 [DEBUG   ] Finished updating board flags in 0.960 seconds
2018-11-25 19:50:06 [DEBUG   ] Got command BAM from MCS: ref #626100
2018-11-25 19:50:06 [INFO    ] Finished processing BAM request
2018-11-25 19:50:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626100   8 58447 71406029 A  ERROR'
2018-11-25 19:50:06 [DEBUG   ] Got command BAM from MCS: ref #626101
2018-11-25 19:50:06 [INFO    ] Finished processing BAM request
2018-11-25 19:50:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626101   8 58447 71406033 A  ERROR'
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:50:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:50:06 [DEBUG   ] spawn_process: at 2018-11-25 19:50:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:50:18 [DEBUG   ] Got command BAM from MCS: ref #626103
2018-11-25 19:50:18 [INFO    ] Finished processing BAM request
2018-11-25 19:50:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626103   8 58447 71418033 A  ERROR'
2018-11-25 19:50:18 [DEBUG   ] Got command BAM from MCS: ref #626102
2018-11-25 19:50:18 [INFO    ] Finished processing BAM request
2018-11-25 19:50:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626102   8 58447 71418037 A  ERROR'
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:50:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:50:18 [DEBUG   ] spawn_process: at 2018-11-25 19:50:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:50:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 19:50:30 [DEBUG   ] Got command BAM from MCS: ref #626105
2018-11-25 19:50:30 [INFO    ] Finished processing BAM request
2018-11-25 19:50:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626105   8 58447 71430033 A  ERROR'
2018-11-25 19:50:30 [DEBUG   ] Got command BAM from MCS: ref #626104
2018-11-25 19:50:30 [INFO    ] Finished processing BAM request
2018-11-25 19:50:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626104   8 58447 71430037 A  ERROR'
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:50:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:50:30 [DEBUG   ] spawn_process: at 2018-11-25 19:50:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:50:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 19:50:42 [DEBUG   ] Got command BAM from MCS: ref #626107
2018-11-25 19:50:42 [INFO    ] Finished processing BAM request
2018-11-25 19:50:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626107   8 58447 71442029 A  ERROR'
2018-11-25 19:50:42 [DEBUG   ] Got command BAM from MCS: ref #626106
2018-11-25 19:50:42 [INFO    ] Finished processing BAM request
2018-11-25 19:50:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626106   8 58447 71442033 A  ERROR'
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:50:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:50:42 [DEBUG   ] spawn_process: at 2018-11-25 19:50:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:50:48 [DEBUG   ] Got command RPT from MCS: ref #626108
2018-11-25 19:50:48 [DEBUG   ] summary = ERROR
2018-11-25 19:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626108  13 58447 71448477 A  ERRORERROR'
2018-11-25 19:50:48 [DEBUG   ] Got command RPT from MCS: ref #626109
2018-11-25 19:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626109  77 58447 71448478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:50:54 [DEBUG   ] Got command BAM from MCS: ref #626125
2018-11-25 19:50:54 [INFO    ] Finished processing BAM request
2018-11-25 19:50:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626125   8 58447 71454025 A  ERROR'
2018-11-25 19:50:54 [DEBUG   ] Got command BAM from MCS: ref #626126
2018-11-25 19:50:54 [INFO    ] Finished processing BAM request
2018-11-25 19:50:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626126   8 58447 71454029 A  ERROR'
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:50:54 [DEBUG   ] spawn_process: at 2018-11-25 19:50:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:51:00 [DEBUG   ] Finished updating ant stats in 1.233 seconds
2018-11-25 19:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 19:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 19:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:51:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 19:51:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:51:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:51:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:51:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:51:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:51:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:51:01 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-25 19:51:06 [DEBUG   ] Got command BAM from MCS: ref #626128
2018-11-25 19:51:06 [INFO    ] Finished processing BAM request
2018-11-25 19:51:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626128   8 58447 71466025 A  ERROR'
2018-11-25 19:51:06 [DEBUG   ] Got command BAM from MCS: ref #626127
2018-11-25 19:51:06 [INFO    ] Finished processing BAM request
2018-11-25 19:51:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626127   8 58447 71466029 A  ERROR'
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:51:06 [DEBUG   ] spawn_process: at 2018-11-25 19:51:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:51:18 [DEBUG   ] Got command BAM from MCS: ref #626129
2018-11-25 19:51:18 [INFO    ] Finished processing BAM request
2018-11-25 19:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626129   8 58447 71478025 A  ERROR'
2018-11-25 19:51:18 [DEBUG   ] Got command BAM from MCS: ref #626130
2018-11-25 19:51:18 [INFO    ] Finished processing BAM request
2018-11-25 19:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626130   8 58447 71478029 A  ERROR'
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:51:18 [DEBUG   ] spawn_process: at 2018-11-25 19:51:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:51:20 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2018-11-25 19:51:30 [DEBUG   ] Got command BAM from MCS: ref #626131
2018-11-25 19:51:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626131   8 58447 71490033 A  ERROR'
2018-11-25 19:51:30 [DEBUG   ] Got command BAM from MCS: ref #626132
2018-11-25 19:51:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626132   8 58447 71490037 A  ERROR'
2018-11-25 19:51:30 [INFO    ] Finished processing BAM request
2018-11-25 19:51:30 [INFO    ] Finished processing BAM request
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:51:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:51:30 [DEBUG   ] spawn_process: at 2018-11-25 19:51:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:51:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:51:42 [DEBUG   ] Got command BAM from MCS: ref #626137
2018-11-25 19:51:42 [INFO    ] Finished processing BAM request
2018-11-25 19:51:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626137   8 58447 71502025 A  ERROR'
2018-11-25 19:51:42 [DEBUG   ] Got command BAM from MCS: ref #626138
2018-11-25 19:51:42 [INFO    ] Finished processing BAM request
2018-11-25 19:51:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626138   8 58447 71502029 A  ERROR'
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:51:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:51:42 [DEBUG   ] spawn_process: at 2018-11-25 19:51:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:51:54 [DEBUG   ] Got command BAM from MCS: ref #626139
2018-11-25 19:51:54 [INFO    ] Finished processing BAM request
2018-11-25 19:51:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626139   8 58447 71514029 A  ERROR'
2018-11-25 19:51:54 [DEBUG   ] Got command BAM from MCS: ref #626140
2018-11-25 19:51:54 [INFO    ] Finished processing BAM request
2018-11-25 19:51:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626140   8 58447 71514033 A  ERROR'
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:51:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:51:54 [DEBUG   ] spawn_process: at 2018-11-25 19:51:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:52:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 19:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:52:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 19:52:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:52:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:52:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:52:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:52:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:52:01 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-25 19:52:06 [DEBUG   ] Got command BAM from MCS: ref #626141
2018-11-25 19:52:06 [INFO    ] Finished processing BAM request
2018-11-25 19:52:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626141   8 58447 71526025 A  ERROR'
2018-11-25 19:52:06 [DEBUG   ] Got command BAM from MCS: ref #626142
2018-11-25 19:52:06 [INFO    ] Finished processing BAM request
2018-11-25 19:52:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626142   8 58447 71526029 A  ERROR'
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:52:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:52:06 [DEBUG   ] spawn_process: at 2018-11-25 19:52:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:52:18 [DEBUG   ] Got command BAM from MCS: ref #626146
2018-11-25 19:52:18 [INFO    ] Finished processing BAM request
2018-11-25 19:52:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626146   8 58447 71538033 A  ERROR'
2018-11-25 19:52:18 [DEBUG   ] Got command BAM from MCS: ref #626145
2018-11-25 19:52:18 [INFO    ] Finished processing BAM request
2018-11-25 19:52:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626145   8 58447 71538041 A  ERROR'
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:52:18 [DEBUG   ] spawn_process: at 2018-11-25 19:52:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:52:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 19:52:24 [DEBUG   ] Got command RPT from MCS: ref #626147
2018-11-25 19:52:24 [DEBUG   ] summary = ERROR
2018-11-25 19:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626147  13 58447 71544449 A  ERRORERROR'
2018-11-25 19:52:24 [DEBUG   ] Got command RPT from MCS: ref #626148
2018-11-25 19:52:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626148  77 58447 71544653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:52:24 [DEBUG   ] Got command RPT from MCS: ref #626149
2018-11-25 19:52:24 [DEBUG   ] summary = ERROR
2018-11-25 19:52:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626149  13 58447 71544857 A  ERRORERROR'
2018-11-25 19:52:25 [DEBUG   ] Got command RPT from MCS: ref #626151
2018-11-25 19:52:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626151  77 58447 71545049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:52:25 [DEBUG   ] Got command RPT from MCS: ref #626152
2018-11-25 19:52:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626152  12 58447 71545253 A  ERRORB¡ff'
2018-11-25 19:52:30 [DEBUG   ] Got command BAM from MCS: ref #626158
2018-11-25 19:52:30 [INFO    ] Finished processing BAM request
2018-11-25 19:52:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626158   8 58447 71550033 A  ERROR'
2018-11-25 19:52:30 [DEBUG   ] Got command BAM from MCS: ref #626157
2018-11-25 19:52:30 [INFO    ] Finished processing BAM request
2018-11-25 19:52:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626157   8 58447 71550037 A  ERROR'
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:52:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:52:30 [DEBUG   ] spawn_process: at 2018-11-25 19:52:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:52:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:52:42 [DEBUG   ] Got command BAM from MCS: ref #626160
2018-11-25 19:52:42 [INFO    ] Finished processing BAM request
2018-11-25 19:52:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626160   8 58447 71562033 A  ERROR'
2018-11-25 19:52:42 [DEBUG   ] Got command BAM from MCS: ref #626159
2018-11-25 19:52:42 [INFO    ] Finished processing BAM request
2018-11-25 19:52:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626159   8 58447 71562037 A  ERROR'
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:52:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:52:42 [DEBUG   ] spawn_process: at 2018-11-25 19:52:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:52:54 [DEBUG   ] Got command BAM from MCS: ref #626162
2018-11-25 19:52:54 [INFO    ] Finished processing BAM request
2018-11-25 19:52:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626162   8 58447 71574033 A  ERROR'
2018-11-25 19:52:54 [DEBUG   ] Got command BAM from MCS: ref #626161
2018-11-25 19:52:54 [INFO    ] Finished processing BAM request
2018-11-25 19:52:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:52:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626161   8 58447 71574037 A  ERROR'
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:52:54 [DEBUG   ] spawn_process: at 2018-11-25 19:52:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:53:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 19:53:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:53:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:53:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:53:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:53:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:53:01 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-25 19:53:06 [DEBUG   ] Got command BAM from MCS: ref #626163
2018-11-25 19:53:06 [INFO    ] Finished processing BAM request
2018-11-25 19:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626163   8 58447 71586025 A  ERROR'
2018-11-25 19:53:06 [DEBUG   ] Got command BAM from MCS: ref #626164
2018-11-25 19:53:06 [INFO    ] Finished processing BAM request
2018-11-25 19:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626164   8 58447 71586029 A  ERROR'
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:53:06 [DEBUG   ] spawn_process: at 2018-11-25 19:53:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:53:18 [DEBUG   ] Got command BAM from MCS: ref #626165
2018-11-25 19:53:18 [INFO    ] Finished processing BAM request
2018-11-25 19:53:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626165   8 58447 71598033 A  ERROR'
2018-11-25 19:53:18 [DEBUG   ] Got command BAM from MCS: ref #626166
2018-11-25 19:53:18 [INFO    ] Finished processing BAM request
2018-11-25 19:53:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626166   8 58447 71598037 A  ERROR'
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:53:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:53:18 [DEBUG   ] spawn_process: at 2018-11-25 19:53:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:53:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:53:30 [DEBUG   ] Got command BAM from MCS: ref #626167
2018-11-25 19:53:30 [INFO    ] Finished processing BAM request
2018-11-25 19:53:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626167   8 58447 71610029 A  ERROR'
2018-11-25 19:53:30 [DEBUG   ] Got command BAM from MCS: ref #626168
2018-11-25 19:53:30 [INFO    ] Finished processing BAM request
2018-11-25 19:53:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626168   8 58447 71610033 A  ERROR'
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:53:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:53:30 [DEBUG   ] spawn_process: at 2018-11-25 19:53:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:53:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:53:42 [DEBUG   ] Got command BAM from MCS: ref #626169
2018-11-25 19:53:42 [INFO    ] Finished processing BAM request
2018-11-25 19:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626169   8 58447 71622025 A  ERROR'
2018-11-25 19:53:42 [DEBUG   ] Got command BAM from MCS: ref #626170
2018-11-25 19:53:42 [INFO    ] Finished processing BAM request
2018-11-25 19:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626170   8 58447 71622029 A  ERROR'
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:53:42 [DEBUG   ] spawn_process: at 2018-11-25 19:53:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:53:54 [DEBUG   ] Got command BAM from MCS: ref #626172
2018-11-25 19:53:54 [INFO    ] Finished processing BAM request
2018-11-25 19:53:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626172   8 58447 71634033 A  ERROR'
2018-11-25 19:53:54 [DEBUG   ] Got command BAM from MCS: ref #626171
2018-11-25 19:53:54 [INFO    ] Finished processing BAM request
2018-11-25 19:53:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:53:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626171   8 58447 71634037 A  ERROR'
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:53:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:53:54 [DEBUG   ] spawn_process: at 2018-11-25 19:53:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:54:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:54:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 19:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:54:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:54:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:54:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:54:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:54:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:54:01 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-11-25 19:54:06 [DEBUG   ] Got command BAM from MCS: ref #626173
2018-11-25 19:54:06 [INFO    ] Finished processing BAM request
2018-11-25 19:54:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626173   8 58447 71646033 A  ERROR'
2018-11-25 19:54:06 [DEBUG   ] Got command BAM from MCS: ref #626174
2018-11-25 19:54:06 [INFO    ] Finished processing BAM request
2018-11-25 19:54:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626174   8 58447 71646037 A  ERROR'
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:54:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:54:06 [DEBUG   ] spawn_process: at 2018-11-25 19:54:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:54:18 [DEBUG   ] Got command BAM from MCS: ref #626175
2018-11-25 19:54:18 [INFO    ] Finished processing BAM request
2018-11-25 19:54:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626175   8 58447 71658029 A  ERROR'
2018-11-25 19:54:18 [DEBUG   ] Got command BAM from MCS: ref #626176
2018-11-25 19:54:18 [INFO    ] Finished processing BAM request
2018-11-25 19:54:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626176   8 58447 71658033 A  ERROR'
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:54:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:54:18 [DEBUG   ] spawn_process: at 2018-11-25 19:54:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:54:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:54:30 [DEBUG   ] Got command BAM from MCS: ref #626177
2018-11-25 19:54:30 [INFO    ] Finished processing BAM request
2018-11-25 19:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626177   8 58447 71670029 A  ERROR'
2018-11-25 19:54:30 [DEBUG   ] Got command BAM from MCS: ref #626178
2018-11-25 19:54:30 [INFO    ] Finished processing BAM request
2018-11-25 19:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626178   8 58447 71670033 A  ERROR'
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:54:30 [DEBUG   ] spawn_process: at 2018-11-25 19:54:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:54:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 19:54:42 [DEBUG   ] Got command BAM from MCS: ref #626184
2018-11-25 19:54:42 [INFO    ] Finished processing BAM request
2018-11-25 19:54:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626184   8 58447 71682033 A  ERROR'
2018-11-25 19:54:42 [DEBUG   ] Got command BAM from MCS: ref #626183
2018-11-25 19:54:42 [INFO    ] Finished processing BAM request
2018-11-25 19:54:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626183   8 58447 71682037 A  ERROR'
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:54:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:54:42 [DEBUG   ] spawn_process: at 2018-11-25 19:54:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:54:54 [DEBUG   ] Got command BAM from MCS: ref #626186
2018-11-25 19:54:54 [INFO    ] Finished processing BAM request
2018-11-25 19:54:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626186   8 58447 71694029 A  ERROR'
2018-11-25 19:54:54 [DEBUG   ] Got command BAM from MCS: ref #626185
2018-11-25 19:54:54 [INFO    ] Finished processing BAM request
2018-11-25 19:54:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626185   8 58447 71694033 A  ERROR'
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:54:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:54:54 [DEBUG   ] spawn_process: at 2018-11-25 19:54:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:55:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 19:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 19:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:55:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 19:55:02 [WARNING ] (13, 1, 'bot')
2018-11-25 19:55:02 [WARNING ] (13, 1, 'bot')
2018-11-25 19:55:02 [WARNING ] (13, 1, 'bot')
2018-11-25 19:55:02 [WARNING ] (13, 1, 'bot')
2018-11-25 19:55:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:55:02 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-11-25 19:55:06 [DEBUG   ] Got command BAM from MCS: ref #626187
2018-11-25 19:55:06 [INFO    ] Finished processing BAM request
2018-11-25 19:55:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626187   8 58447 71706033 A  ERROR'
2018-11-25 19:55:06 [DEBUG   ] Got command BAM from MCS: ref #626188
2018-11-25 19:55:06 [INFO    ] Finished processing BAM request
2018-11-25 19:55:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626188   8 58447 71706041 A  ERROR'
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:55:06 [DEBUG   ] spawn_process: at 2018-11-25 19:55:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:55:19 [DEBUG   ] Got command BAM from MCS: ref #626189
2018-11-25 19:55:19 [INFO    ] Finished processing BAM request
2018-11-25 19:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626189   8 58447 71719033 A  ERROR'
2018-11-25 19:55:19 [DEBUG   ] Got command BAM from MCS: ref #626190
2018-11-25 19:55:19 [INFO    ] Finished processing BAM request
2018-11-25 19:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626190   8 58447 71719041 A  ERROR'
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:55:19 [DEBUG   ] spawn_process: at 2018-11-25 19:55:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:55:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 19:55:32 [DEBUG   ] Got command BAM from MCS: ref #626191
2018-11-25 19:55:32 [INFO    ] Finished processing BAM request
2018-11-25 19:55:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626191   8 58447 71732029 A  ERROR'
2018-11-25 19:55:32 [DEBUG   ] Got command BAM from MCS: ref #626192
2018-11-25 19:55:32 [INFO    ] Finished processing BAM request
2018-11-25 19:55:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626192   8 58447 71732033 A  ERROR'
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:55:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:55:32 [DEBUG   ] spawn_process: at 2018-11-25 19:55:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:55:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:55:45 [DEBUG   ] Got command BAM from MCS: ref #626194
2018-11-25 19:55:45 [INFO    ] Finished processing BAM request
2018-11-25 19:55:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626194   8 58447 71745029 A  ERROR'
2018-11-25 19:55:45 [DEBUG   ] Got command BAM from MCS: ref #626193
2018-11-25 19:55:45 [INFO    ] Finished processing BAM request
2018-11-25 19:55:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626193   8 58447 71745033 A  ERROR'
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:55:45 [DEBUG   ] spawn_process: at 2018-11-25 19:55:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:55:48 [DEBUG   ] Got command RPT from MCS: ref #626195
2018-11-25 19:55:48 [DEBUG   ] summary = ERROR
2018-11-25 19:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626195  13 58447 71748481 A  ERRORERROR'
2018-11-25 19:55:48 [DEBUG   ] Got command RPT from MCS: ref #626196
2018-11-25 19:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626196  77 58447 71748482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:55:58 [DEBUG   ] Got command BAM from MCS: ref #626213
2018-11-25 19:55:58 [INFO    ] Finished processing BAM request
2018-11-25 19:55:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626213   8 58447 71758025 A  ERROR'
2018-11-25 19:55:58 [DEBUG   ] Got command BAM from MCS: ref #626212
2018-11-25 19:55:58 [INFO    ] Finished processing BAM request
2018-11-25 19:55:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626212   8 58447 71758029 A  ERROR'
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:55:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:55:58 [DEBUG   ] spawn_process: at 2018-11-25 19:55:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:56:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 19:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 19:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 19:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:56:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:56:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:56:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:56:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:56:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:56:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:56:01 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-11-25 19:56:11 [DEBUG   ] Got command BAM from MCS: ref #626214
2018-11-25 19:56:11 [INFO    ] Finished processing BAM request
2018-11-25 19:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626214   8 58447 71771033 A  ERROR'
2018-11-25 19:56:11 [DEBUG   ] Got command BAM from MCS: ref #626215
2018-11-25 19:56:11 [INFO    ] Finished processing BAM request
2018-11-25 19:56:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626215   8 58447 71771037 A  ERROR'
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:56:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:56:11 [DEBUG   ] spawn_process: at 2018-11-25 19:56:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:56:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 19:56:24 [DEBUG   ] Got command BAM from MCS: ref #626216
2018-11-25 19:56:24 [INFO    ] Finished processing BAM request
2018-11-25 19:56:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:56:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626216   8 58447 71784025 A  ERROR'
2018-11-25 19:56:24 [DEBUG   ] Got command BAM from MCS: ref #626217
2018-11-25 19:56:24 [INFO    ] Finished processing BAM request
2018-11-25 19:56:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:56:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626217   8 58447 71784029 A  ERROR'
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:56:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:56:24 [DEBUG   ] spawn_process: at 2018-11-25 19:56:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:56:37 [DEBUG   ] Got command BAM from MCS: ref #626219
2018-11-25 19:56:37 [INFO    ] Finished processing BAM request
2018-11-25 19:56:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626219   8 58447 71797029 A  ERROR'
2018-11-25 19:56:37 [DEBUG   ] Got command BAM from MCS: ref #626218
2018-11-25 19:56:37 [INFO    ] Finished processing BAM request
2018-11-25 19:56:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626218   8 58447 71797033 A  ERROR'
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 19:56:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 19:56:37 [DEBUG   ] spawn_process: at 2018-11-25 19:56:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 19:56:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:56:50 [DEBUG   ] Got command BAM from MCS: ref #626220
2018-11-25 19:56:50 [INFO    ] Finished processing BAM request
2018-11-25 19:56:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626220   8 58447 71810025 A  ERROR'
2018-11-25 19:56:50 [DEBUG   ] Got command BAM from MCS: ref #626221
2018-11-25 19:56:50 [INFO    ] Finished processing BAM request
2018-11-25 19:56:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626221   8 58447 71810029 A  ERROR'
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 19:56:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 19:56:50 [DEBUG   ] spawn_process: at 2018-11-25 19:56:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 19:57:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:57:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 19:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 19:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:57:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:57:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 19:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 19:57:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:57:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:57:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:57:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:57:01 [DEBUG   ] Finished updating board flags in 1.271 seconds
2018-11-25 19:57:03 [DEBUG   ] Got command BAM from MCS: ref #626222
2018-11-25 19:57:03 [INFO    ] Finished processing BAM request
2018-11-25 19:57:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626222   8 58447 71823025 A  ERROR'
2018-11-25 19:57:03 [DEBUG   ] Got command BAM from MCS: ref #626223
2018-11-25 19:57:03 [INFO    ] Finished processing BAM request
2018-11-25 19:57:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626223   8 58447 71823029 A  ERROR'
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:57:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:57:03 [DEBUG   ] spawn_process: at 2018-11-25 19:57:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:57:16 [DEBUG   ] Got command BAM from MCS: ref #626225
2018-11-25 19:57:16 [INFO    ] Finished processing BAM request
2018-11-25 19:57:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626225   8 58447 71836025 A  ERROR'
2018-11-25 19:57:16 [DEBUG   ] Got command BAM from MCS: ref #626224
2018-11-25 19:57:16 [INFO    ] Finished processing BAM request
2018-11-25 19:57:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626224   8 58447 71836029 A  ERROR'
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 19:57:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 19:57:16 [DEBUG   ] spawn_process: at 2018-11-25 19:57:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 19:57:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:57:24 [DEBUG   ] Got command RPT from MCS: ref #626226
2018-11-25 19:57:24 [DEBUG   ] summary = ERROR
2018-11-25 19:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626226  13 58447 71844537 A  ERRORERROR'
2018-11-25 19:57:24 [DEBUG   ] Got command RPT from MCS: ref #626227
2018-11-25 19:57:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626227  77 58447 71844741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:57:24 [DEBUG   ] Got command RPT from MCS: ref #626228
2018-11-25 19:57:24 [DEBUG   ] summary = ERROR
2018-11-25 19:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626228  13 58447 71844933 A  ERRORERROR'
2018-11-25 19:57:25 [DEBUG   ] Got command RPT from MCS: ref #626229
2018-11-25 19:57:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 19:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626229  77 58447 71845137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 19:57:25 [DEBUG   ] Got command RPT from MCS: ref #626230
2018-11-25 19:57:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 19:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626230  12 58447 71845341 A  ERRORB£ff'
2018-11-25 19:57:29 [DEBUG   ] Got command BAM from MCS: ref #626232
2018-11-25 19:57:29 [INFO    ] Finished processing BAM request
2018-11-25 19:57:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626232   8 58447 71849029 A  ERROR'
2018-11-25 19:57:29 [DEBUG   ] Got command BAM from MCS: ref #626231
2018-11-25 19:57:29 [INFO    ] Finished processing BAM request
2018-11-25 19:57:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626231   8 58447 71849033 A  ERROR'
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 19:57:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 19:57:29 [DEBUG   ] spawn_process: at 2018-11-25 19:57:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 19:57:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 19:57:42 [DEBUG   ] Got command BAM from MCS: ref #626237
2018-11-25 19:57:42 [INFO    ] Finished processing BAM request
2018-11-25 19:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626237   8 58447 71862033 A  ERROR'
2018-11-25 19:57:42 [DEBUG   ] Got command BAM from MCS: ref #626238
2018-11-25 19:57:42 [INFO    ] Finished processing BAM request
2018-11-25 19:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626238   8 58447 71862037 A  ERROR'
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:57:42 [DEBUG   ] spawn_process: at 2018-11-25 19:57:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:57:55 [DEBUG   ] Got command BAM from MCS: ref #626240
2018-11-25 19:57:55 [INFO    ] Finished processing BAM request
2018-11-25 19:57:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626240   8 58447 71875029 A  ERROR'
2018-11-25 19:57:55 [DEBUG   ] Got command BAM from MCS: ref #626239
2018-11-25 19:57:55 [INFO    ] Finished processing BAM request
2018-11-25 19:57:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 19:57:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626239   8 58447 71875033 A  ERROR'
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:57:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:57:55 [DEBUG   ] spawn_process: at 2018-11-25 19:57:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:58:00 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 19:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:58:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 19:58:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 19:58:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 19:58:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:58:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:58:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:58:01 [WARNING ] (13, 1, 'bot')
2018-11-25 19:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:58:01 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-11-25 19:58:09 [DEBUG   ] Got command STP from MCS: ref #626241
2018-11-25 19:58:09 [INFO    ] Finished processing BAM request
2018-11-25 19:58:09 [INFO    ] Shutdown the adder chain on beam #3
2018-11-25 19:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   626241   8 58447 71889117 A  ERROR'
2018-11-25 19:58:09 [DEBUG   ] Got command STP from MCS: ref #626242
2018-11-25 19:58:09 [INFO    ] Finished processing BAM request
2018-11-25 19:58:09 [INFO    ] Shutdown the adder chain on beam #4
2018-11-25 19:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   626242   8 58447 71889121 A  ERROR'
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 19:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 19:58:09 [DEBUG   ] spawn_process: at 2018-11-25 19:58:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 19:58:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:58:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 19:59:01 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2018-11-25 19:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 19:59:02 [WARNING ] (13, 1, 'bot')
2018-11-25 19:59:02 [WARNING ] (13, 1, 'bot')
2018-11-25 19:59:02 [WARNING ] (13, 1, 'bot')
2018-11-25 19:59:02 [WARNING ] (13, 1, 'bot')
2018-11-25 19:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 19:59:02 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-11-25 19:59:21 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-11-25 19:59:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 20:00:01 [DEBUG   ] Finished updating ant stats in 1.032 seconds
2018-11-25 20:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 20:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:00:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:00:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:00:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:00:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:00:02 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-25 20:00:21 [DEBUG   ] Finished updating ant stats in 0.966 seconds
2018-11-25 20:00:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:00:48 [DEBUG   ] Got command RPT from MCS: ref #626247
2018-11-25 20:00:48 [DEBUG   ] summary = ERROR
2018-11-25 20:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626247  13 58447 72048485 A  ERRORERROR'
2018-11-25 20:00:48 [DEBUG   ] Got command RPT from MCS: ref #626248
2018-11-25 20:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626248  77 58447 72048486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:01:01 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2018-11-25 20:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 20:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-25 20:01:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 20:01:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:01:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:01:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:01:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:01:02 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-11-25 20:01:21 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2018-11-25 20:01:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 20:02:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 20:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 20:02:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 20:02:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:02:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:02:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:02:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:02:02 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-11-25 20:02:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:02:24 [DEBUG   ] Got command RPT from MCS: ref #626266
2018-11-25 20:02:24 [DEBUG   ] summary = ERROR
2018-11-25 20:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626266  13 58447 72144625 A  ERRORERROR'
2018-11-25 20:02:24 [DEBUG   ] Got command RPT from MCS: ref #626267
2018-11-25 20:02:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:02:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626267  77 58447 72144829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:02:25 [DEBUG   ] Got command RPT from MCS: ref #626268
2018-11-25 20:02:25 [DEBUG   ] summary = ERROR
2018-11-25 20:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626268  13 58447 72145021 A  ERRORERROR'
2018-11-25 20:02:25 [DEBUG   ] Got command RPT from MCS: ref #626270
2018-11-25 20:02:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626270  77 58447 72145225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:02:25 [DEBUG   ] Got command RPT from MCS: ref #626271
2018-11-25 20:02:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626271  12 58447 72145429 A  ERRORBš™š'
2018-11-25 20:02:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 20:03:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-25 20:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:03:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:03:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:03:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:03:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:03:02 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-25 20:03:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 20:03:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:04:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 20:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:04:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:04:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:04:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:04:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:04:02 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-25 20:04:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 20:04:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 20:05:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 20:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:05:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:05:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:05:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:05:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:05:02 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-25 20:05:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:05:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:05:48 [DEBUG   ] Got command RPT from MCS: ref #626280
2018-11-25 20:05:48 [DEBUG   ] summary = ERROR
2018-11-25 20:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626280  13 58447 72348485 A  ERRORERROR'
2018-11-25 20:05:48 [DEBUG   ] Got command RPT from MCS: ref #626281
2018-11-25 20:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626281  77 58447 72348486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:06:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 20:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:06:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:06:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:06:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:06:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:06:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:06:03 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-11-25 20:06:21 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 20:06:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:07:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:07:02 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2018-11-25 20:07:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:07:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:07:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:07:02 [WARNING ] (13, 1, 'bot')
2018-11-25 20:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:07:02 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-11-25 20:07:22 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-11-25 20:07:24 [DEBUG   ] Got command RPT from MCS: ref #626301
2018-11-25 20:07:24 [DEBUG   ] summary = ERROR
2018-11-25 20:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626301  13 58447 72444709 A  ERRORERROR'
2018-11-25 20:07:24 [DEBUG   ] Got command RPT from MCS: ref #626302
2018-11-25 20:07:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:07:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626302  77 58447 72444913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:07:25 [DEBUG   ] Got command RPT from MCS: ref #626303
2018-11-25 20:07:25 [DEBUG   ] summary = ERROR
2018-11-25 20:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626303  13 58447 72445105 A  ERRORERROR'
2018-11-25 20:07:25 [DEBUG   ] Got command RPT from MCS: ref #626304
2018-11-25 20:07:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626304  77 58447 72445309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:07:25 [DEBUG   ] Got command RPT from MCS: ref #626305
2018-11-25 20:07:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626305  12 58447 72445513 A  ERRORB™™š'
2018-11-25 20:07:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:08:02 [DEBUG   ] Finished updating ant stats in 1.031 seconds
2018-11-25 20:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:08:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:08:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:08:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:08:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:08:03 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-11-25 20:08:22 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-25 20:08:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:09:02 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2018-11-25 20:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:09:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:09:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:09:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:09:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:09:03 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-25 20:09:22 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-25 20:09:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:10:02 [DEBUG   ] Finished updating ant stats in 0.633 seconds
2018-11-25 20:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:10:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:10:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:10:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:10:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:10:03 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-25 20:10:22 [DEBUG   ] Finished updating ant stats in 0.570 seconds
2018-11-25 20:10:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:10:48 [DEBUG   ] Got command RPT from MCS: ref #626310
2018-11-25 20:10:48 [DEBUG   ] summary = ERROR
2018-11-25 20:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626310  13 58447 72648489 A  ERRORERROR'
2018-11-25 20:10:48 [DEBUG   ] Got command RPT from MCS: ref #626311
2018-11-25 20:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626311  77 58447 72648490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:11:02 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-11-25 20:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:11:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 20:11:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:11:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:11:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:11:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:11:03 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-11-25 20:11:22 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-25 20:11:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:12:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 20:12:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:12:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 20:12:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:12:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:12:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:12:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:12:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:12:04 [DEBUG   ] Finished updating board flags in 2.418 seconds
2018-11-25 20:12:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 20:12:24 [DEBUG   ] Got command RPT from MCS: ref #626329
2018-11-25 20:12:24 [DEBUG   ] summary = ERROR
2018-11-25 20:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626329  13 58447 72744801 A  ERRORERROR'
2018-11-25 20:12:24 [DEBUG   ] Got command RPT from MCS: ref #626330
2018-11-25 20:12:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626330  77 58447 72744993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:12:25 [DEBUG   ] Got command RPT from MCS: ref #626331
2018-11-25 20:12:25 [DEBUG   ] summary = ERROR
2018-11-25 20:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626331  13 58447 72745197 A  ERRORERROR'
2018-11-25 20:12:25 [DEBUG   ] Got command RPT from MCS: ref #626333
2018-11-25 20:12:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626333  77 58447 72745401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:12:25 [DEBUG   ] Got command RPT from MCS: ref #626334
2018-11-25 20:12:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626334  12 58447 72745593 A  ERRORB—™š'
2018-11-25 20:12:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:13:03 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-11-25 20:13:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:13:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:13:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:13:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:13:03 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-11-25 20:13:23 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-25 20:13:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:14:03 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2018-11-25 20:14:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:14:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:14:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:14:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:14:03 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-11-25 20:14:23 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-25 20:14:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 20:15:03 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-11-25 20:15:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:15:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:15:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:15:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:15:03 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-11-25 20:15:23 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-25 20:15:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:15:48 [DEBUG   ] Got command RPT from MCS: ref #626347
2018-11-25 20:15:48 [DEBUG   ] summary = ERROR
2018-11-25 20:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626347  13 58447 72948489 A  ERRORERROR'
2018-11-25 20:15:48 [DEBUG   ] Got command RPT from MCS: ref #626348
2018-11-25 20:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626348  77 58447 72948490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:16:03 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-11-25 20:16:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:16:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:16:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:16:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:16:03 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-25 20:16:23 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-25 20:16:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:17:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:17:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:17:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:17:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:17:03 [DEBUG   ] Finished updating board flags in 1.163 seconds
2018-11-25 20:17:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:17:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:17:24 [DEBUG   ] Got command RPT from MCS: ref #626364
2018-11-25 20:17:24 [DEBUG   ] summary = ERROR
2018-11-25 20:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626364  13 58447 73044877 A  ERRORERROR'
2018-11-25 20:17:25 [DEBUG   ] Got command RPT from MCS: ref #626365
2018-11-25 20:17:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626365  77 58447 73045081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:17:25 [DEBUG   ] Got command RPT from MCS: ref #626366
2018-11-25 20:17:25 [DEBUG   ] summary = ERROR
2018-11-25 20:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626366  13 58447 73045285 A  ERRORERROR'
2018-11-25 20:17:25 [DEBUG   ] Got command RPT from MCS: ref #626367
2018-11-25 20:17:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626367  77 58447 73045489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:17:25 [DEBUG   ] Got command RPT from MCS: ref #626368
2018-11-25 20:17:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626368  12 58447 73045681 A  ERRORB˜™š'
2018-11-25 20:17:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:18:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 20:18:04 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2018-11-25 20:18:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:18:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:18:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:18:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:18:04 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-11-25 20:18:24 [DEBUG   ] Finished updating ant stats in 1.162 seconds
2018-11-25 20:18:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:19:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 20:19:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:19:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:19:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:19:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:19:03 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-11-25 20:19:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 20:19:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:19:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 20:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 20:20:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:20:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:20:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:20:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:20:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:20:03 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-11-25 20:20:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 20:20:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 20:20:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:20:48 [DEBUG   ] Got command RPT from MCS: ref #626373
2018-11-25 20:20:48 [DEBUG   ] summary = ERROR
2018-11-25 20:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626373  13 58447 73248489 A  ERRORERROR'
2018-11-25 20:20:48 [DEBUG   ] Got command RPT from MCS: ref #626374
2018-11-25 20:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626374  77 58447 73248490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:21:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:21:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:21:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:21:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:21:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:21:03 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-11-25 20:21:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:21:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:21:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 20:22:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:22:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:22:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:22:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:22:03 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-25 20:22:04 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 20:22:24 [DEBUG   ] Got command RPT from MCS: ref #626396
2018-11-25 20:22:24 [DEBUG   ] summary = ERROR
2018-11-25 20:22:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626396  13 58447 73344965 A  ERRORERROR'
2018-11-25 20:22:25 [DEBUG   ] Got command RPT from MCS: ref #626397
2018-11-25 20:22:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626397  77 58447 73345169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:22:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:22:25 [DEBUG   ] Got command RPT from MCS: ref #626398
2018-11-25 20:22:25 [DEBUG   ] summary = ERROR
2018-11-25 20:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626398  13 58447 73345373 A  ERRORERROR'
2018-11-25 20:22:25 [DEBUG   ] Got command RPT from MCS: ref #626400
2018-11-25 20:22:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626400  77 58447 73345565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:22:25 [DEBUG   ] Got command RPT from MCS: ref #626401
2018-11-25 20:22:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626401  12 58447 73345769 A  ERRORB™™š'
2018-11-25 20:22:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 20:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:23:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:23:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:23:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:23:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:23:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:23:03 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-25 20:23:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:23:25 [DEBUG   ] Finished updating ant stats in 1.134 seconds
2018-11-25 20:23:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:24:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:24:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:24:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:24:03 [WARNING ] (13, 1, 'bot')
2018-11-25 20:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:24:03 [DEBUG   ] Finished updating board flags in 0.950 seconds
2018-11-25 20:24:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:24:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:24:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:25:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:25:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:25:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:25:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:25:04 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-11-25 20:25:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:25:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 20:25:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:25:48 [DEBUG   ] Got command RPT from MCS: ref #626415
2018-11-25 20:25:48 [DEBUG   ] summary = ERROR
2018-11-25 20:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626415  13 58447 73548493 A  ERRORERROR'
2018-11-25 20:25:48 [DEBUG   ] Got command RPT from MCS: ref #626416
2018-11-25 20:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626416  77 58447 73548494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:26:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-25 20:26:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:26:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:26:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:26:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:26:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:26:05 [DEBUG   ] Finished updating board flags in 2.129 seconds
2018-11-25 20:26:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 20:26:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:27:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:27:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:27:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:27:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:27:04 [DEBUG   ] Finished updating board flags in 1.043 seconds
2018-11-25 20:27:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:27:25 [DEBUG   ] Got command RPT from MCS: ref #626437
2018-11-25 20:27:25 [DEBUG   ] summary = ERROR
2018-11-25 20:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626437  13 58447 73645061 A  ERRORERROR'
2018-11-25 20:27:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 20:27:25 [DEBUG   ] Got command RPT from MCS: ref #626438
2018-11-25 20:27:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626438  77 58447 73645253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:27:25 [DEBUG   ] Got command RPT from MCS: ref #626439
2018-11-25 20:27:25 [DEBUG   ] summary = ERROR
2018-11-25 20:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626439  13 58447 73645457 A  ERRORERROR'
2018-11-25 20:27:25 [DEBUG   ] Got command RPT from MCS: ref #626440
2018-11-25 20:27:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626440  77 58447 73645661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:27:25 [DEBUG   ] Got command RPT from MCS: ref #626441
2018-11-25 20:27:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626441  12 58447 73645853 A  ERRORB˜™š'
2018-11-25 20:27:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:28:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:28:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:28:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:28:04 [WARNING ] (13, 1, 'bot')
2018-11-25 20:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:28:04 [DEBUG   ] Finished updating board flags in 1.085 seconds
2018-11-25 20:28:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:28:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:28:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:29:05 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2018-11-25 20:29:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:29:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:29:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:29:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:29:05 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-11-25 20:29:25 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-25 20:29:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:30:05 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-11-25 20:30:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:30:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:30:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:30:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:30:05 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-25 20:30:25 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-25 20:30:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:30:48 [DEBUG   ] Got command RPT from MCS: ref #626450
2018-11-25 20:30:48 [DEBUG   ] summary = ERROR
2018-11-25 20:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626450  13 58447 73848489 A  ERRORERROR'
2018-11-25 20:30:48 [DEBUG   ] Got command RPT from MCS: ref #626451
2018-11-25 20:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626451  77 58447 73848490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:31:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:31:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:31:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:31:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:31:05 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-11-25 20:31:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-25 20:31:25 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-25 20:31:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 20:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:32:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 20:32:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:32:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:32:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:32:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:32:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:32:06 [DEBUG   ] Finished updating board flags in 2.559 seconds
2018-11-25 20:32:25 [DEBUG   ] Got command RPT from MCS: ref #626469
2018-11-25 20:32:25 [DEBUG   ] summary = ERROR
2018-11-25 20:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626469  13 58447 73945141 A  ERRORERROR'
2018-11-25 20:32:25 [DEBUG   ] Got command RPT from MCS: ref #626470
2018-11-25 20:32:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626470  77 58447 73945337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:32:25 [DEBUG   ] Got command RPT from MCS: ref #626471
2018-11-25 20:32:25 [DEBUG   ] summary = ERROR
2018-11-25 20:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626471  13 58447 73945541 A  ERRORERROR'
2018-11-25 20:32:25 [DEBUG   ] Got command RPT from MCS: ref #626473
2018-11-25 20:32:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626473  77 58447 73945745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:32:25 [DEBUG   ] Got command RPT from MCS: ref #626474
2018-11-25 20:32:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:32:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626474  12 58447 73945949 A  ERRORB—™š'
2018-11-25 20:32:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 20:32:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:33:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 20:33:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:33:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:33:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:33:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:33:06 [DEBUG   ] Finished updating board flags in 2.200 seconds
2018-11-25 20:33:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:33:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:34:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:34:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:34:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:34:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:34:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:34:06 [DEBUG   ] Finished updating board flags in 1.848 seconds
2018-11-25 20:34:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-25 20:34:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 20:34:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:35:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:35:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:35:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:35:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:35:05 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-11-25 20:35:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:35:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:35:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:35:48 [DEBUG   ] Got command RPT from MCS: ref #626483
2018-11-25 20:35:48 [DEBUG   ] summary = ERROR
2018-11-25 20:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626483  13 58447 74148497 A  ERRORERROR'
2018-11-25 20:35:48 [DEBUG   ] Got command RPT from MCS: ref #626484
2018-11-25 20:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626484  77 58447 74148498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:36:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:36:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 20:36:06 [DEBUG   ] Finished updating ant stats in 0.634 seconds
2018-11-25 20:36:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:36:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:36:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:36:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:36:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:36:06 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-11-25 20:36:26 [DEBUG   ] Finished updating ant stats in 0.570 seconds
2018-11-25 20:36:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 20:37:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:37:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:37:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:37:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:37:05 [DEBUG   ] Finished updating board flags in 1.123 seconds
2018-11-25 20:37:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:37:25 [DEBUG   ] Got command RPT from MCS: ref #626504
2018-11-25 20:37:25 [DEBUG   ] summary = ERROR
2018-11-25 20:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626504  13 58447 74245229 A  ERRORERROR'
2018-11-25 20:37:25 [DEBUG   ] Got command RPT from MCS: ref #626505
2018-11-25 20:37:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626505  77 58447 74245421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:37:25 [DEBUG   ] Got command RPT from MCS: ref #626506
2018-11-25 20:37:25 [DEBUG   ] summary = ERROR
2018-11-25 20:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626506  13 58447 74245625 A  ERRORERROR'
2018-11-25 20:37:25 [DEBUG   ] Got command RPT from MCS: ref #626507
2018-11-25 20:37:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:37:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626507  77 58447 74245829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:37:26 [DEBUG   ] Got command RPT from MCS: ref #626508
2018-11-25 20:37:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626508  12 58447 74246033 A  ERRORB—™š'
2018-11-25 20:37:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:37:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:38:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 20:38:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:38:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:38:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:38:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:38:05 [DEBUG   ] Finished updating board flags in 1.044 seconds
2018-11-25 20:38:06 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 20:38:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:38:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:39:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:39:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:39:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:39:05 [WARNING ] (13, 1, 'bot')
2018-11-25 20:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:39:05 [DEBUG   ] Finished updating board flags in 0.947 seconds
2018-11-25 20:39:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:39:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 20:39:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 20:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:40:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:40:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:40:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:40:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:40:06 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-11-25 20:40:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 20:40:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:40:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:40:48 [DEBUG   ] Got command RPT from MCS: ref #626513
2018-11-25 20:40:48 [DEBUG   ] summary = ERROR
2018-11-25 20:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626513  13 58447 74448493 A  ERRORERROR'
2018-11-25 20:40:48 [DEBUG   ] Got command RPT from MCS: ref #626514
2018-11-25 20:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626514  77 58447 74448494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 20:41:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:41:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:41:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:41:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:41:06 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-11-25 20:41:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-25 20:41:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:41:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:42:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:42:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:42:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:42:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:42:06 [DEBUG   ] Finished updating board flags in 1.257 seconds
2018-11-25 20:42:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:42:25 [DEBUG   ] Got command RPT from MCS: ref #626532
2018-11-25 20:42:25 [DEBUG   ] summary = ERROR
2018-11-25 20:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626532  13 58447 74545309 A  ERRORERROR'
2018-11-25 20:42:25 [DEBUG   ] Got command RPT from MCS: ref #626533
2018-11-25 20:42:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626533  77 58447 74545513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:42:25 [DEBUG   ] Got command RPT from MCS: ref #626534
2018-11-25 20:42:25 [DEBUG   ] summary = ERROR
2018-11-25 20:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626534  13 58447 74545717 A  ERRORERROR'
2018-11-25 20:42:25 [DEBUG   ] Got command RPT from MCS: ref #626536
2018-11-25 20:42:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:42:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626536  77 58447 74545921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:42:26 [DEBUG   ] Got command RPT from MCS: ref #626537
2018-11-25 20:42:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626537  12 58447 74546113 A  ERRORB˜™š'
2018-11-25 20:42:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:42:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:43:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 20:43:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:43:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:43:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:43:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:43:06 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-11-25 20:43:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:43:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:43:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:44:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 20:44:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:44:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:44:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:44:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:44:06 [DEBUG   ] Finished updating board flags in 1.149 seconds
2018-11-25 20:44:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:44:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:44:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 20:45:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:45:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:45:07 [DEBUG   ] Finished updating ant stats in 1.034 seconds
2018-11-25 20:45:07 [WARNING ] (13, 1, 'bot')
2018-11-25 20:45:07 [WARNING ] (13, 1, 'bot')
2018-11-25 20:45:07 [WARNING ] (13, 1, 'bot')
2018-11-25 20:45:07 [WARNING ] (13, 1, 'bot')
2018-11-25 20:45:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:45:07 [DEBUG   ] Finished updating board flags in 2.100 seconds
2018-11-25 20:45:27 [DEBUG   ] Finished updating ant stats in 0.970 seconds
2018-11-25 20:45:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:45:48 [DEBUG   ] Got command RPT from MCS: ref #626550
2018-11-25 20:45:48 [DEBUG   ] summary = ERROR
2018-11-25 20:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626550  13 58447 74748501 A  ERRORERROR'
2018-11-25 20:45:48 [DEBUG   ] Got command RPT from MCS: ref #626551
2018-11-25 20:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626551  77 58447 74748502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:46:00 [DEBUG   ] Got command RPT from MCS: ref #626567
2018-11-25 20:46:00 [DEBUG   ] summary = ERROR
2018-11-25 20:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626567  13 58447 74760489 A  ERRORERROR'
2018-11-25 20:46:00 [DEBUG   ] Got command RPT from MCS: ref #626568
2018-11-25 20:46:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626568  77 58447 74760490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:46:05 [DEBUG   ] Got command INI from MCS: ref #626569
2018-11-25 20:46:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-25 20:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   626569   8 58447 74765498 ABOOTING'
2018-11-25 20:46:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 20:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 20:46:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:46:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:46:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:46:06 [WARNING ] (13, 1, 'bot')
2018-11-25 20:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:46:06 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-11-25 20:46:07 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2018-11-25 20:46:26 [INFO    ] -------------------
2018-11-25 20:46:26 [INFO    ]  LWA board status
2018-11-25 20:46:26 [INFO    ] -------------------
2018-11-25 20:46:26 [INFO    ] DP 1: 2 lwa27
2018-11-25 20:46:26 [INFO    ] DP 1: 3 lwa24
2018-11-25 20:46:26 [INFO    ] DP 1: 4 lwa23
2018-11-25 20:46:26 [INFO    ] DP 1: 5 lwa18
2018-11-25 20:46:26 [INFO    ] DP 1: 6 lwa10
2018-11-25 20:46:26 [INFO    ] DP 1: 7 lwa32
2018-11-25 20:46:26 [INFO    ] DP 1: 8 lwa11
2018-11-25 20:46:26 [INFO    ] DP 1: 9 lwa30
2018-11-25 20:46:26 [INFO    ] DP 1: 10 lwa12
2018-11-25 20:46:26 [INFO    ] DP 1: 11 lwa8
2018-11-25 20:46:26 [INFO    ] DP 1: 12 lwa13
2018-11-25 20:46:26 [INFO    ] DP 1: 13 lwa26
2018-11-25 20:46:26 [INFO    ] DP 1: 14 lwa14
2018-11-25 20:46:26 [INFO    ] DP 1: 16 lwa22
2018-11-25 20:46:26 [INFO    ] DP 1: 17 lwa20
2018-11-25 20:46:26 [INFO    ] DP 1: 18 lwa1
2018-11-25 20:46:26 [INFO    ] DP 1: 19 lwa5
2018-11-25 20:46:26 [INFO    ] DP 1: 20 lwa25
2018-11-25 20:46:26 [INFO    ] DP 1: 21 lwa35
2018-11-25 20:46:26 [INFO    ] DP 1: 22 lwa19
2018-11-25 20:46:26 [INFO    ] DP 1: 23 lwa21
2018-11-25 20:46:26 [INFO    ] DP 1: 24 lwa6
2018-11-25 20:46:26 [INFO    ] DP 1: 25 lwa7
2018-11-25 20:46:26 [INFO    ] DP 1: 26 lwa33
2018-11-25 20:46:26 [INFO    ] DP 1: 27 lwa15
2018-11-25 20:46:26 [INFO    ] DP 1: 28 lwa28
2018-11-25 20:46:26 [INFO    ] DP 2: 1 lwa16
2018-11-25 20:46:26 [INFO    ] DP 2: 15 lwa34
2018-11-25 20:46:26 [INFO    ] Total of 28 boards
2018-11-25 20:46:26 [INFO    ] Total of 260 stands
2018-11-25 20:46:26 [INFO    ] -------------------
2018-11-25 20:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12419
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12420
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12421
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12422
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12423
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12424
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12425
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12426
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12427
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12428
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12429
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12430
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12431
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12432
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12433
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12434
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12435
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12436
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12437
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12438
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12439
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12440
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12441
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12442
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12443
2018-11-25 20:46:33 [DEBUG   ] 2018-11-25 20:46:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12444
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12419 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12420 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12421 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12422 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12423 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12424 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12425 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12426 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12427 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12428 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12429 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12430 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12431 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12432 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12433 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12434 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12435 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12436 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12437 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12438 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12439 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12440 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12441 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12442 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12443 exited with status 0
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12444 exited with status 0
2018-11-25 20:46:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] spawn_process: at 2018-11-25 20:46:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12471
2018-11-25 20:46:45 [DEBUG   ] 2018-11-25 20:46:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12472
2018-11-25 20:46:51 [DEBUG   ] 2018-11-25 20:46:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12471 exited with status 0
2018-11-25 20:46:51 [DEBUG   ] 2018-11-25 20:46:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12472 exited with status 0
2018-11-25 20:46:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-25 20:46:51 [DEBUG   ] spawn_process: at 2018-11-25 20:46:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-25 20:46:51 [DEBUG   ] spawn_process: at 2018-11-25 20:46:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-25 20:46:51 [INFO    ] Setting Beam 1 xbars
2018-11-25 20:46:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-25 20:46:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-25 20:46:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-25 20:46:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-25 20:46:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-25 20:46:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-25 20:46:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-25 20:46:54 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-25 20:46:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-25 20:46:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-25 20:46:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-25 20:46:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-25 20:46:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-25 20:46:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-25 20:46:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-25 20:46:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-25 20:46:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-25 20:46:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-25 20:46:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-25 20:46:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-25 20:46:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-25 20:46:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-25 20:46:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-25 20:46:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-25 20:46:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-25 20:46:56 [INFO    ] Setting Beam 2 xbars
2018-11-25 20:46:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-25 20:46:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-25 20:46:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-25 20:46:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-25 20:47:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-25 20:47:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-25 20:47:02 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-25 20:47:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-25 20:47:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-25 20:47:02 [INFO    ] Setting Beam 3 xbars
2018-11-25 20:47:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-25 20:47:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-25 20:47:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-25 20:47:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-25 20:47:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-25 20:47:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-25 20:47:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-25 20:47:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-25 20:47:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-25 20:47:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-25 20:47:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-25 20:47:07 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-25 20:47:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-25 20:47:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-25 20:47:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-25 20:47:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-25 20:47:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-25 20:47:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-25 20:47:07 [INFO    ] Setting Beam 4 xbars
2018-11-25 20:47:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-25 20:47:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-25 20:47:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-25 20:47:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-25 20:47:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-25 20:47:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-25 20:47:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-25 20:47:13 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-25 20:47:13 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-25 20:47:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-25 20:47:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-25 20:47:13 [INFO    ] All xbars set
2018-11-25 20:47:13 [INFO    ] Setting adder chain routing for all beams
2018-11-25 20:47:18 [INFO    ] Setting beam ids
2018-11-25 20:47:25 [DEBUG   ] Got command RPT from MCS: ref #626570
2018-11-25 20:47:25 [DEBUG   ] summary = ERROR
2018-11-25 20:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626570  13 58447 74845397 A  ERRORERROR'
2018-11-25 20:47:25 [DEBUG   ] Got command RPT from MCS: ref #626571
2018-11-25 20:47:25 [DEBUG   ] info = Starting calibration
2018-11-25 20:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626571  28 58447 74845601 A  ERRORStarting calibration'
2018-11-25 20:47:25 [DEBUG   ] Got command RPT from MCS: ref #626572
2018-11-25 20:47:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626572  12 58447 74845805 A  ERRORB˜™š'
2018-11-25 20:47:28 [INFO    ] Starting beam delay calibration
2018-11-25 20:47:40 [INFO    ] Beam 1 latency is 5722
2018-11-25 20:47:40 [INFO    ] Beam 2 latency is 6698
2018-11-25 20:47:40 [INFO    ] Beam 3 latency is 6691
2018-11-25 20:47:40 [INFO    ] Beam 4 latency is 5722
2018-11-25 20:47:40 [INFO    ] Stop calibration
2018-11-25 20:47:48 [ERROR   ] Beam delay calibration failed
2018-11-25 20:47:48 [CRITICAL] Calibration failed
2018-11-25 20:47:48 [DEBUG   ] spawn_process: at 2018-11-25 20:47:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-25 20:47:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-25 20:47:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-25 20:47:48 [DEBUG   ] spawn_process: at 2018-11-25 20:47:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-25 20:47:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-25 20:47:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-25 20:47:48 [DEBUG   ] spawn_process: at 2018-11-25 20:47:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-25 20:47:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-25 20:47:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-25 20:47:48 [DEBUG   ] spawn_process: at 2018-11-25 20:47:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-25 20:47:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-25 20:47:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-25 20:47:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-25 20:47:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 274 ms (1543178869.276 s) with PID 14051 and time 1543178870
2018-11-25 20:47:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-25 20:47:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 361 ms (1543178869.363 s) with PID 14054 and time 1543178870
2018-11-25 20:47:50 [DEBUG   ] Finished updating ant stats in 0.884 seconds
2018-11-25 20:47:50 [INFO    ] Started antennas statistics background thread
2018-11-25 20:47:50 [INFO    ] Started board flags background thread
2018-11-25 20:47:50 [INFO    ] Started BAM background thread
2018-11-25 20:47:50 [INFO    ] Finished the INI process (ref. #626569) in 104.989 s
2018-11-25 20:47:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:47:51 [WARNING ] (13, 1, 'bot')
2018-11-25 20:47:51 [WARNING ] (13, 1, 'bot')
2018-11-25 20:47:51 [WARNING ] (13, 1, 'bot')
2018-11-25 20:47:51 [WARNING ] (13, 1, 'bot')
2018-11-25 20:47:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-25 20:47:51 [DEBUG   ] Finished updating board flags in 1.064 seconds
2018-11-25 20:48:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:48:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:48:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 20:48:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:48:51 [WARNING ] (13, 1, 'bot')
2018-11-25 20:48:51 [WARNING ] (13, 1, 'bot')
2018-11-25 20:48:51 [WARNING ] (13, 1, 'bot')
2018-11-25 20:48:51 [WARNING ] (13, 1, 'bot')
2018-11-25 20:48:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-25 20:48:51 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-25 20:49:05 [DEBUG   ] Got command RPT from MCS: ref #626577
2018-11-25 20:49:05 [DEBUG   ] summary = ERROR
2018-11-25 20:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626577  13 58447 74945505 A  ERRORERROR'
2018-11-25 20:49:05 [DEBUG   ] Got command RPT from MCS: ref #626578
2018-11-25 20:49:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:49:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626578  98 58447 74945506 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:49:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:49:10 [DEBUG   ] Got command INI from MCS: ref #626579
2018-11-25 20:49:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-25 20:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   626579   8 58447 74950514 ABOOTING'
2018-11-25 20:49:31 [INFO    ] -------------------
2018-11-25 20:49:31 [INFO    ]  LWA board status
2018-11-25 20:49:31 [INFO    ] -------------------
2018-11-25 20:49:31 [INFO    ] DP 1: 2 lwa27
2018-11-25 20:49:31 [INFO    ] DP 1: 3 lwa24
2018-11-25 20:49:31 [INFO    ] DP 1: 4 lwa23
2018-11-25 20:49:31 [INFO    ] DP 1: 5 lwa18
2018-11-25 20:49:31 [INFO    ] DP 1: 6 lwa10
2018-11-25 20:49:31 [INFO    ] DP 1: 7 lwa32
2018-11-25 20:49:31 [INFO    ] DP 1: 8 lwa11
2018-11-25 20:49:31 [INFO    ] DP 1: 9 lwa30
2018-11-25 20:49:31 [INFO    ] DP 1: 10 lwa12
2018-11-25 20:49:31 [INFO    ] DP 1: 11 lwa8
2018-11-25 20:49:31 [INFO    ] DP 1: 12 lwa13
2018-11-25 20:49:31 [INFO    ] DP 1: 13 lwa26
2018-11-25 20:49:31 [INFO    ] DP 1: 14 lwa14
2018-11-25 20:49:31 [INFO    ] DP 1: 16 lwa22
2018-11-25 20:49:31 [INFO    ] DP 1: 17 lwa20
2018-11-25 20:49:31 [INFO    ] DP 1: 18 lwa1
2018-11-25 20:49:31 [INFO    ] DP 1: 19 lwa5
2018-11-25 20:49:31 [INFO    ] DP 1: 20 lwa25
2018-11-25 20:49:31 [INFO    ] DP 1: 21 lwa35
2018-11-25 20:49:31 [INFO    ] DP 1: 22 lwa19
2018-11-25 20:49:31 [INFO    ] DP 1: 23 lwa21
2018-11-25 20:49:31 [INFO    ] DP 1: 24 lwa6
2018-11-25 20:49:31 [INFO    ] DP 1: 25 lwa7
2018-11-25 20:49:31 [INFO    ] DP 1: 26 lwa33
2018-11-25 20:49:31 [INFO    ] DP 1: 27 lwa15
2018-11-25 20:49:31 [INFO    ] DP 1: 28 lwa28
2018-11-25 20:49:31 [INFO    ] DP 2: 1 lwa16
2018-11-25 20:49:31 [INFO    ] DP 2: 15 lwa34
2018-11-25 20:49:31 [INFO    ] Total of 28 boards
2018-11-25 20:49:31 [INFO    ] Total of 260 stands
2018-11-25 20:49:31 [INFO    ] -------------------
2018-11-25 20:49:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14605
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14606
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14607
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14608
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14609
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14610
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14611
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14612
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14613
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14614
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14615
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14616
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14617
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14618
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14619
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14620
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14621
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14622
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14623
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14624
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14625
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14626
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14627
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14628
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14629
2018-11-25 20:49:38 [DEBUG   ] 2018-11-25 20:49:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14630
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14605 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14606 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14607 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14608 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14609 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14610 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14611 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14612 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14613 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14614 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14615 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14616 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14617 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14618 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14619 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14620 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14621 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14622 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14623 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14624 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14625 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14626 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14627 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14628 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14629 exited with status 0
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14630 exited with status 0
2018-11-25 20:49:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] spawn_process: at 2018-11-25 20:49:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14657
2018-11-25 20:49:50 [DEBUG   ] 2018-11-25 20:49:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14658
2018-11-25 20:49:56 [DEBUG   ] 2018-11-25 20:49:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14657 exited with status 0
2018-11-25 20:49:56 [DEBUG   ] 2018-11-25 20:49:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14658 exited with status 0
2018-11-25 20:49:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-25 20:49:56 [DEBUG   ] spawn_process: at 2018-11-25 20:49:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-25 20:49:56 [DEBUG   ] spawn_process: at 2018-11-25 20:49:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-25 20:49:56 [INFO    ] Setting Beam 1 xbars
2018-11-25 20:49:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-25 20:49:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-25 20:49:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-25 20:49:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-25 20:49:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-25 20:49:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-25 20:49:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-25 20:49:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-25 20:49:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-25 20:49:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-25 20:49:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-25 20:49:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-25 20:49:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-25 20:49:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-25 20:49:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-25 20:50:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-25 20:50:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-25 20:50:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-25 20:50:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-25 20:50:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-25 20:50:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-25 20:50:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-25 20:50:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-25 20:50:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-25 20:50:01 [INFO    ] Setting Beam 2 xbars
2018-11-25 20:50:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-25 20:50:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-25 20:50:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-25 20:50:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-25 20:50:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-25 20:50:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-25 20:50:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-25 20:50:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-25 20:50:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-25 20:50:07 [INFO    ] Setting Beam 3 xbars
2018-11-25 20:50:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-25 20:50:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-25 20:50:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-25 20:50:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-25 20:50:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-25 20:50:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-25 20:50:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-25 20:50:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-25 20:50:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-25 20:50:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-25 20:50:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-25 20:50:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-25 20:50:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-25 20:50:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-25 20:50:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-25 20:50:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-25 20:50:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-25 20:50:12 [INFO    ] Setting Beam 4 xbars
2018-11-25 20:50:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-25 20:50:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-25 20:50:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-25 20:50:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-25 20:50:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-25 20:50:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-25 20:50:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-25 20:50:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-25 20:50:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-25 20:50:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-25 20:50:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-25 20:50:18 [INFO    ] All xbars set
2018-11-25 20:50:18 [INFO    ] Setting adder chain routing for all beams
2018-11-25 20:50:23 [INFO    ] Setting beam ids
2018-11-25 20:50:33 [INFO    ] Starting beam delay calibration
2018-11-25 20:50:45 [INFO    ] Beam 1 latency is 5728
2018-11-25 20:50:45 [INFO    ] Beam 2 latency is 5734
2018-11-25 20:50:45 [INFO    ] Beam 3 latency is 5737
2018-11-25 20:50:45 [INFO    ] Beam 4 latency is 5736
2018-11-25 20:50:45 [INFO    ] Stop calibration
2018-11-25 20:50:48 [DEBUG   ] Got command RPT from MCS: ref #626580
2018-11-25 20:50:48 [DEBUG   ] summary = BOOTING
2018-11-25 20:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626580  15 58447 75048494 ABOOTINGBOOTING'
2018-11-25 20:50:48 [DEBUG   ] Got command RPT from MCS: ref #626581
2018-11-25 20:50:48 [DEBUG   ] info = Starting calibration
2018-11-25 20:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626581  28 58447 75048494 ABOOTINGStarting calibration'
2018-11-25 20:50:53 [INFO    ] Beam delay calibration successful
2018-11-25 20:50:53 [INFO    ] Calibration passed
2018-11-25 20:50:53 [DEBUG   ] spawn_process: at 2018-11-25 20:50:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-25 20:50:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-25 20:50:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-25 20:50:53 [DEBUG   ] spawn_process: at 2018-11-25 20:50:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-25 20:50:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-25 20:50:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-25 20:50:53 [DEBUG   ] spawn_process: at 2018-11-25 20:50:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-25 20:50:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-25 20:50:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-25 20:50:53 [DEBUG   ] spawn_process: at 2018-11-25 20:50:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-25 20:50:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-25 20:50:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-25 20:50:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-25 20:50:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 265 ms (1543179054.267 s) with PID 16253 and time 1543179055
2018-11-25 20:50:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-25 20:50:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 355 ms (1543179054.357 s) with PID 16256 and time 1543179055
2018-11-25 20:50:55 [DEBUG   ] Finished updating ant stats in 0.891 seconds
2018-11-25 20:50:55 [INFO    ] Started antennas statistics background thread
2018-11-25 20:50:55 [INFO    ] Started board flags background thread
2018-11-25 20:50:55 [INFO    ] Started BAM background thread
2018-11-25 20:50:55 [INFO    ] Finished the INI process (ref. #626579) in 104.964 s
2018-11-25 20:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:50:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:50:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:50:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:50:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:50:56 [DEBUG   ] Finished updating board flags in 1.077 seconds
2018-11-25 20:51:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:51:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:51:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:51:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:51:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:51:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:51:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:51:56 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-25 20:52:10 [DEBUG   ] Got command RPT from MCS: ref #626603
2018-11-25 20:52:10 [DEBUG   ] summary = ERROR
2018-11-25 20:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626603  13 58447 75130505 A  ERRORERROR'
2018-11-25 20:52:10 [DEBUG   ] Got command RPT from MCS: ref #626604
2018-11-25 20:52:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626604  77 58447 75130506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:52:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:52:25 [DEBUG   ] Got command RPT from MCS: ref #626605
2018-11-25 20:52:25 [DEBUG   ] summary = ERROR
2018-11-25 20:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626605  13 58447 75145481 A  ERRORERROR'
2018-11-25 20:52:25 [DEBUG   ] Got command RPT from MCS: ref #626606
2018-11-25 20:52:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626606  77 58447 75145685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:52:25 [DEBUG   ] Got command RPT from MCS: ref #626607
2018-11-25 20:52:25 [DEBUG   ] summary = ERROR
2018-11-25 20:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626607  13 58447 75145889 A  ERRORERROR'
2018-11-25 20:52:26 [DEBUG   ] Got command RPT from MCS: ref #626608
2018-11-25 20:52:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626608  77 58447 75146081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:52:26 [DEBUG   ] Got command RPT from MCS: ref #626610
2018-11-25 20:52:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626610  12 58447 75146285 A  ERRORB—™š'
2018-11-25 20:52:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:52:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:52:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:52:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:52:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:52:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:52:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:52:57 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-11-25 20:53:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:53:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:53:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:53:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:53:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:53:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:53:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:53:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:53:57 [DEBUG   ] Finished updating board flags in 1.734 seconds
2018-11-25 20:54:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:54:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:54:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:54:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:54:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:54:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:54:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:54:57 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-11-25 20:55:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:55:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:55:48 [DEBUG   ] Got command RPT from MCS: ref #626619
2018-11-25 20:55:48 [DEBUG   ] summary = ERROR
2018-11-25 20:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626619  13 58447 75348497 A  ERRORERROR'
2018-11-25 20:55:48 [DEBUG   ] Got command RPT from MCS: ref #626620
2018-11-25 20:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626620  77 58447 75348498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:55:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:55:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 20:55:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:55:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:55:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:55:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:55:56 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-11-25 20:56:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:56:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:56:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:56:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:56:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:56:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:56:56 [WARNING ] (13, 1, 'bot')
2018-11-25 20:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:56:56 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-11-25 20:57:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:57:25 [DEBUG   ] Got command RPT from MCS: ref #626636
2018-11-25 20:57:25 [DEBUG   ] summary = ERROR
2018-11-25 20:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626636  13 58447 75445565 A  ERRORERROR'
2018-11-25 20:57:25 [DEBUG   ] Got command RPT from MCS: ref #626637
2018-11-25 20:57:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626637  77 58447 75445769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:57:25 [DEBUG   ] Got command RPT from MCS: ref #626638
2018-11-25 20:57:25 [DEBUG   ] summary = ERROR
2018-11-25 20:57:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626638  13 58447 75445973 A  ERRORERROR'
2018-11-25 20:57:26 [DEBUG   ] Got command RPT from MCS: ref #626639
2018-11-25 20:57:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 20:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626639  77 58447 75446165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 20:57:26 [DEBUG   ] Got command RPT from MCS: ref #626640
2018-11-25 20:57:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 20:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626640  12 58447 75446369 A  ERRORB—™š'
2018-11-25 20:57:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:57:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 20:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 20:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:57:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:57:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:57:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:57:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:57:57 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-11-25 20:58:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 20:58:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:58:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 20:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:58:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:58:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:58:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:58:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:58:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:58:57 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-25 20:59:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 20:59:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:59:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 20:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 20:59:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:59:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:59:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:59:57 [WARNING ] (13, 1, 'bot')
2018-11-25 20:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 20:59:57 [DEBUG   ] Finished updating board flags in 1.133 seconds
2018-11-25 21:00:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:00:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:00:48 [DEBUG   ] Got command RPT from MCS: ref #626649
2018-11-25 21:00:48 [DEBUG   ] summary = ERROR
2018-11-25 21:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626649  13 58447 75648501 A  ERRORERROR'
2018-11-25 21:00:48 [DEBUG   ] Got command RPT from MCS: ref #626650
2018-11-25 21:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626650  77 58447 75648502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:00:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 21:00:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:00:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:00:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:00:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:00:57 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-11-25 21:01:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:01:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:01:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:01:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:01:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:01:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:01:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:01:57 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-25 21:02:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:02:25 [DEBUG   ] Got command RPT from MCS: ref #626668
2018-11-25 21:02:25 [DEBUG   ] summary = ERROR
2018-11-25 21:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626668  13 58447 75745649 A  ERRORERROR'
2018-11-25 21:02:25 [DEBUG   ] Got command RPT from MCS: ref #626669
2018-11-25 21:02:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626669  77 58447 75745854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:02:26 [DEBUG   ] Got command RPT from MCS: ref #626670
2018-11-25 21:02:26 [DEBUG   ] summary = ERROR
2018-11-25 21:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626670  13 58447 75746049 A  ERRORERROR'
2018-11-25 21:02:26 [DEBUG   ] Got command RPT from MCS: ref #626672
2018-11-25 21:02:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626672  77 58447 75746253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:02:26 [DEBUG   ] Got command RPT from MCS: ref #626673
2018-11-25 21:02:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626673  12 58447 75746457 A  ERRORB™™š'
2018-11-25 21:02:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:02:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:02:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:02:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:02:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:02:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:02:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:02:58 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-11-25 21:03:15 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 21:03:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:03:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:03:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:03:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:03:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:03:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:03:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:03:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:03:57 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-25 21:04:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:04:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:04:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:04:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:04:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:04:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:04:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:04:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:04:57 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-11-25 21:05:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:05:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:05:48 [DEBUG   ] Got command RPT from MCS: ref #626682
2018-11-25 21:05:48 [DEBUG   ] summary = ERROR
2018-11-25 21:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626682  13 58447 75948501 A  ERRORERROR'
2018-11-25 21:05:48 [DEBUG   ] Got command RPT from MCS: ref #626683
2018-11-25 21:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626683  77 58447 75948502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:05:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:05:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:05:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:05:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:05:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:05:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:05:57 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-11-25 21:06:15 [DEBUG   ] Got command BAM from MCS: ref #626703
2018-11-25 21:06:15 [INFO    ] Finished processing BAM request
2018-11-25 21:06:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626703   8 58447 75975033 A  ERROR'
2018-11-25 21:06:15 [DEBUG   ] Got command BAM from MCS: ref #626704
2018-11-25 21:06:15 [INFO    ] Finished processing BAM request
2018-11-25 21:06:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626704   8 58447 75975037 A  ERROR'
2018-11-25 21:06:15 [DEBUG   ] Got command DRX from MCS: ref #626705
2018-11-25 21:06:15 [INFO    ] sending drx command to lwa16
2018-11-25 21:06:15 [DEBUG   ] run_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 9']
2018-11-25 21:06:15 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-25 21:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   626705   8 58447 75975101 A  ERROR'
2018-11-25 21:06:15 [DEBUG   ] Got command DRX from MCS: ref #626706
2018-11-25 21:06:15 [INFO    ] sending drx command to lwa34
2018-11-25 21:06:15 [DEBUG   ] run_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 9']
2018-11-25 21:06:15 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-25 21:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   626706   8 58447 75975109 A  ERROR'
2018-11-25 21:06:15 [DEBUG   ] Got command DRX from MCS: ref #626708
2018-11-25 21:06:15 [INFO    ] sending drx command to lwa34
2018-11-25 21:06:15 [DEBUG   ] run_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 9']
2018-11-25 21:06:15 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-25 21:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   626708   8 58447 75975117 A  ERROR'
2018-11-25 21:06:15 [DEBUG   ] Got command DRX from MCS: ref #626707
2018-11-25 21:06:15 [INFO    ] sending drx command to lwa16
2018-11-25 21:06:15 [DEBUG   ] run_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 9']
2018-11-25 21:06:15 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-25 21:06:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   626707   8 58447 75975125 A  ERROR'
2018-11-25 21:06:15 [INFO    ] Finished starting DRX
2018-11-25 21:06:15 [INFO    ] Finished starting DRX
2018-11-25 21:06:15 [INFO    ] Finished starting DRX
2018-11-25 21:06:15 [INFO    ] Finished starting DRX
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:06:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:06:15 [DEBUG   ] spawn_process: at 2018-11-25 21:06:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:06:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:06:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:06:49 [DEBUG   ] Got command BAM from MCS: ref #626716
2018-11-25 21:06:49 [INFO    ] Finished processing BAM request
2018-11-25 21:06:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626716   8 58447 76009029 A  ERROR'
2018-11-25 21:06:49 [DEBUG   ] Got command BAM from MCS: ref #626715
2018-11-25 21:06:49 [INFO    ] Finished processing BAM request
2018-11-25 21:06:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626715   8 58447 76009033 A  ERROR'
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:06:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:06:49 [DEBUG   ] spawn_process: at 2018-11-25 21:06:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:06:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:06:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:06:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 21:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:06:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:06:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:06:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:06:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:06:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:06:57 [DEBUG   ] Finished updating board flags in 1.313 seconds
2018-11-25 21:07:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:07:23 [DEBUG   ] Got command BAM from MCS: ref #626717
2018-11-25 21:07:23 [INFO    ] Finished processing BAM request
2018-11-25 21:07:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626717   8 58447 76043025 A  ERROR'
2018-11-25 21:07:23 [DEBUG   ] Got command BAM from MCS: ref #626718
2018-11-25 21:07:23 [INFO    ] Finished processing BAM request
2018-11-25 21:07:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:07:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626718   8 58447 76043029 A  ERROR'
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:07:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:07:23 [DEBUG   ] spawn_process: at 2018-11-25 21:07:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:07:25 [DEBUG   ] Got command RPT from MCS: ref #626719
2018-11-25 21:07:25 [DEBUG   ] summary = ERROR
2018-11-25 21:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626719  13 58447 76045741 A  ERRORERROR'
2018-11-25 21:07:25 [DEBUG   ] Got command RPT from MCS: ref #626720
2018-11-25 21:07:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:07:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626720  77 58447 76045945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:07:26 [DEBUG   ] Got command RPT from MCS: ref #626721
2018-11-25 21:07:26 [DEBUG   ] summary = ERROR
2018-11-25 21:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626721  13 58447 76046149 A  ERRORERROR'
2018-11-25 21:07:26 [DEBUG   ] Got command RPT from MCS: ref #626722
2018-11-25 21:07:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626722  77 58447 76046341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:07:26 [DEBUG   ] Got command RPT from MCS: ref #626723
2018-11-25 21:07:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626723  12 58447 76046545 A  ERRORB�ff'
2018-11-25 21:07:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:07:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:07:57 [DEBUG   ] Got command BAM from MCS: ref #626724
2018-11-25 21:07:57 [INFO    ] Finished processing BAM request
2018-11-25 21:07:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:07:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626724   8 58447 76077025 A  ERROR'
2018-11-25 21:07:57 [DEBUG   ] Got command BAM from MCS: ref #626725
2018-11-25 21:07:57 [INFO    ] Finished processing BAM request
2018-11-25 21:07:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:07:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626725   8 58447 76077029 A  ERROR'
2018-11-25 21:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-25 21:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:07:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:07:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:07:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:07:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:07:57 [DEBUG   ] Finished updating board flags in 1.222 seconds
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:07:57 [DEBUG   ] spawn_process: at 2018-11-25 21:07:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:08:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 21:08:31 [DEBUG   ] Got command BAM from MCS: ref #626727
2018-11-25 21:08:31 [INFO    ] Finished processing BAM request
2018-11-25 21:08:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626727   8 58447 76111025 A  ERROR'
2018-11-25 21:08:31 [DEBUG   ] Got command BAM from MCS: ref #626726
2018-11-25 21:08:31 [INFO    ] Finished processing BAM request
2018-11-25 21:08:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626726   8 58447 76111029 A  ERROR'
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:08:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:08:31 [DEBUG   ] spawn_process: at 2018-11-25 21:08:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:08:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:08:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-25 21:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 21:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:08:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:08:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:08:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:08:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:08:57 [WARNING ] (13, 1, 'bot')
2018-11-25 21:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:08:57 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-25 21:09:05 [DEBUG   ] Got command BAM from MCS: ref #626728
2018-11-25 21:09:05 [INFO    ] Finished processing BAM request
2018-11-25 21:09:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626728   8 58447 76145033 A  ERROR'
2018-11-25 21:09:05 [DEBUG   ] Got command BAM from MCS: ref #626729
2018-11-25 21:09:05 [INFO    ] Finished processing BAM request
2018-11-25 21:09:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:09:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626729   8 58447 76145037 A  ERROR'
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:09:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:09:05 [DEBUG   ] spawn_process: at 2018-11-25 21:09:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:09:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:09:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:09:39 [DEBUG   ] Got command BAM from MCS: ref #626734
2018-11-25 21:09:39 [INFO    ] Finished processing BAM request
2018-11-25 21:09:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626734   8 58447 76179029 A  ERROR'
2018-11-25 21:09:39 [DEBUG   ] Got command BAM from MCS: ref #626735
2018-11-25 21:09:39 [INFO    ] Finished processing BAM request
2018-11-25 21:09:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626735   8 58447 76179033 A  ERROR'
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:09:39 [DEBUG   ] spawn_process: at 2018-11-25 21:09:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:09:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:09:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:09:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:09:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:09:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:09:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:09:58 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-11-25 21:10:13 [DEBUG   ] Got command BAM from MCS: ref #626737
2018-11-25 21:10:13 [INFO    ] Finished processing BAM request
2018-11-25 21:10:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626737   8 58447 76213025 A  ERROR'
2018-11-25 21:10:13 [DEBUG   ] Got command BAM from MCS: ref #626736
2018-11-25 21:10:13 [INFO    ] Finished processing BAM request
2018-11-25 21:10:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626736   8 58447 76213029 A  ERROR'
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:10:13 [DEBUG   ] spawn_process: at 2018-11-25 21:10:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:10:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-25 21:10:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:10:47 [DEBUG   ] Got command BAM from MCS: ref #626739
2018-11-25 21:10:47 [INFO    ] Finished processing BAM request
2018-11-25 21:10:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:10:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626739   8 58447 76247025 A  ERROR'
2018-11-25 21:10:47 [DEBUG   ] Got command BAM from MCS: ref #626738
2018-11-25 21:10:47 [INFO    ] Finished processing BAM request
2018-11-25 21:10:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:10:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626738   8 58447 76247029 A  ERROR'
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:10:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:10:47 [DEBUG   ] spawn_process: at 2018-11-25 21:10:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:10:48 [DEBUG   ] Got command RPT from MCS: ref #626740
2018-11-25 21:10:48 [DEBUG   ] summary = ERROR
2018-11-25 21:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626740  13 58447 76248509 A  ERRORERROR'
2018-11-25 21:10:48 [DEBUG   ] Got command RPT from MCS: ref #626741
2018-11-25 21:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626741  77 58447 76248510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:10:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 21:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-11-25 21:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 21:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:10:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:10:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:10:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:10:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:10:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:10:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:10:58 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-11-25 21:11:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:11:20 [DEBUG   ] Got command BAM from MCS: ref #626757
2018-11-25 21:11:20 [INFO    ] Finished processing BAM request
2018-11-25 21:11:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626757   8 58447 76280029 A  ERROR'
2018-11-25 21:11:20 [DEBUG   ] Got command BAM from MCS: ref #626758
2018-11-25 21:11:20 [INFO    ] Finished processing BAM request
2018-11-25 21:11:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626758   8 58447 76280033 A  ERROR'
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:11:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:11:20 [DEBUG   ] spawn_process: at 2018-11-25 21:11:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:11:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:11:53 [DEBUG   ] Got command BAM from MCS: ref #626759
2018-11-25 21:11:53 [INFO    ] Finished processing BAM request
2018-11-25 21:11:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626759   8 58447 76313033 A  ERROR'
2018-11-25 21:11:53 [DEBUG   ] Got command BAM from MCS: ref #626760
2018-11-25 21:11:53 [INFO    ] Finished processing BAM request
2018-11-25 21:11:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626760   8 58447 76313037 A  ERROR'
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:11:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:11:53 [DEBUG   ] spawn_process: at 2018-11-25 21:11:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:11:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:11:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:11:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:11:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:11:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:11:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:11:58 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-25 21:12:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:12:25 [DEBUG   ] Got command RPT from MCS: ref #626765
2018-11-25 21:12:25 [DEBUG   ] summary = ERROR
2018-11-25 21:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626765  13 58447 76345833 A  ERRORERROR'
2018-11-25 21:12:26 [DEBUG   ] Got command BAM from MCS: ref #626763
2018-11-25 21:12:26 [INFO    ] Finished processing BAM request
2018-11-25 21:12:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626763   8 58447 76346029 A  ERROR'
2018-11-25 21:12:26 [DEBUG   ] Got command BAM from MCS: ref #626764
2018-11-25 21:12:26 [INFO    ] Finished processing BAM request
2018-11-25 21:12:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626764   8 58447 76346033 A  ERROR'
2018-11-25 21:12:26 [DEBUG   ] Got command RPT from MCS: ref #626766
2018-11-25 21:12:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626766  77 58447 76346034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:12:26 [DEBUG   ] Got command RPT from MCS: ref #626767
2018-11-25 21:12:26 [DEBUG   ] summary = ERROR
2018-11-25 21:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626767  13 58447 76346225 A  ERRORERROR'
2018-11-25 21:12:26 [DEBUG   ] Got command RPT from MCS: ref #626769
2018-11-25 21:12:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626769  77 58447 76346429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:12:26 [DEBUG   ] Got command RPT from MCS: ref #626770
2018-11-25 21:12:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626770  12 58447 76346633 A  ERRORB¢ff'
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:12:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:12:26 [DEBUG   ] spawn_process: at 2018-11-25 21:12:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:12:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:12:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 21:12:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:12:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:12:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:12:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:12:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:12:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:12:58 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-25 21:12:59 [DEBUG   ] Got command BAM from MCS: ref #626780
2018-11-25 21:12:59 [INFO    ] Finished processing BAM request
2018-11-25 21:12:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:12:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626780   8 58447 76379033 A  ERROR'
2018-11-25 21:12:59 [DEBUG   ] Got command BAM from MCS: ref #626779
2018-11-25 21:12:59 [INFO    ] Finished processing BAM request
2018-11-25 21:12:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:12:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626779   8 58447 76379037 A  ERROR'
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:12:59 [DEBUG   ] spawn_process: at 2018-11-25 21:12:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:13:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 21:13:32 [DEBUG   ] Got command BAM from MCS: ref #626782
2018-11-25 21:13:32 [INFO    ] Finished processing BAM request
2018-11-25 21:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626782   8 58447 76412029 A  ERROR'
2018-11-25 21:13:32 [DEBUG   ] Got command BAM from MCS: ref #626781
2018-11-25 21:13:32 [INFO    ] Finished processing BAM request
2018-11-25 21:13:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626781   8 58447 76412033 A  ERROR'
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:13:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:13:32 [DEBUG   ] spawn_process: at 2018-11-25 21:13:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:13:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:13:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 21:13:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:13:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:13:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:13:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:13:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:13:58 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-11-25 21:14:05 [DEBUG   ] Got command BAM from MCS: ref #626783
2018-11-25 21:14:05 [INFO    ] Finished processing BAM request
2018-11-25 21:14:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626783   8 58447 76445025 A  ERROR'
2018-11-25 21:14:05 [DEBUG   ] Got command BAM from MCS: ref #626784
2018-11-25 21:14:05 [INFO    ] Finished processing BAM request
2018-11-25 21:14:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626784   8 58447 76445029 A  ERROR'
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:14:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:14:05 [DEBUG   ] spawn_process: at 2018-11-25 21:14:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:14:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:14:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 21:14:38 [DEBUG   ] Got command BAM from MCS: ref #626785
2018-11-25 21:14:38 [INFO    ] Finished processing BAM request
2018-11-25 21:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626785   8 58447 76478033 A  ERROR'
2018-11-25 21:14:38 [DEBUG   ] Got command BAM from MCS: ref #626786
2018-11-25 21:14:38 [INFO    ] Finished processing BAM request
2018-11-25 21:14:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626786   8 58447 76478037 A  ERROR'
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:14:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:14:38 [DEBUG   ] spawn_process: at 2018-11-25 21:14:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:14:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 21:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 21:14:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:14:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:14:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:14:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:14:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:14:58 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-25 21:15:11 [DEBUG   ] Got command BAM from MCS: ref #626787
2018-11-25 21:15:11 [INFO    ] Finished processing BAM request
2018-11-25 21:15:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626787   8 58447 76511029 A  ERROR'
2018-11-25 21:15:11 [DEBUG   ] Got command BAM from MCS: ref #626788
2018-11-25 21:15:11 [INFO    ] Finished processing BAM request
2018-11-25 21:15:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626788   8 58447 76511033 A  ERROR'
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:15:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:15:11 [DEBUG   ] spawn_process: at 2018-11-25 21:15:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:15:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:15:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:15:44 [DEBUG   ] Got command BAM from MCS: ref #626793
2018-11-25 21:15:44 [INFO    ] Finished processing BAM request
2018-11-25 21:15:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626793   8 58447 76544033 A  ERROR'
2018-11-25 21:15:44 [DEBUG   ] Got command BAM from MCS: ref #626794
2018-11-25 21:15:44 [INFO    ] Finished processing BAM request
2018-11-25 21:15:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626794   8 58447 76544037 A  ERROR'
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:15:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:15:44 [DEBUG   ] spawn_process: at 2018-11-25 21:15:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:15:48 [DEBUG   ] Got command RPT from MCS: ref #626795
2018-11-25 21:15:48 [DEBUG   ] summary = ERROR
2018-11-25 21:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626795  13 58447 76548501 A  ERRORERROR'
2018-11-25 21:15:48 [DEBUG   ] Got command RPT from MCS: ref #626796
2018-11-25 21:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626796  77 58447 76548502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:15:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:15:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:15:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:15:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:15:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:15:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:15:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:15:58 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-25 21:16:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:16:17 [DEBUG   ] Got command BAM from MCS: ref #626813
2018-11-25 21:16:17 [INFO    ] Finished processing BAM request
2018-11-25 21:16:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626813   8 58447 76577025 A  ERROR'
2018-11-25 21:16:17 [DEBUG   ] Got command BAM from MCS: ref #626812
2018-11-25 21:16:17 [INFO    ] Finished processing BAM request
2018-11-25 21:16:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:16:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626812   8 58447 76577029 A  ERROR'
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:16:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:16:17 [DEBUG   ] spawn_process: at 2018-11-25 21:16:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:16:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:16:50 [DEBUG   ] Got command BAM from MCS: ref #626815
2018-11-25 21:16:50 [INFO    ] Finished processing BAM request
2018-11-25 21:16:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626815   8 58447 76610033 A  ERROR'
2018-11-25 21:16:50 [DEBUG   ] Got command BAM from MCS: ref #626814
2018-11-25 21:16:50 [INFO    ] Finished processing BAM request
2018-11-25 21:16:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626814   8 58447 76610037 A  ERROR'
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:16:50 [DEBUG   ] spawn_process: at 2018-11-25 21:16:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:16:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 21:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 21:16:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:16:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:16:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:16:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:16:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:16:58 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-11-25 21:17:16 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-25 21:17:23 [DEBUG   ] Got command BAM from MCS: ref #626816
2018-11-25 21:17:23 [INFO    ] Finished processing BAM request
2018-11-25 21:17:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626816   8 58447 76643025 A  ERROR'
2018-11-25 21:17:23 [DEBUG   ] Got command BAM from MCS: ref #626817
2018-11-25 21:17:23 [INFO    ] Finished processing BAM request
2018-11-25 21:17:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:17:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626817   8 58447 76643029 A  ERROR'
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:17:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:17:23 [DEBUG   ] spawn_process: at 2018-11-25 21:17:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:17:25 [DEBUG   ] Got command RPT from MCS: ref #626818
2018-11-25 21:17:25 [DEBUG   ] summary = ERROR
2018-11-25 21:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626818  13 58447 76645909 A  ERRORERROR'
2018-11-25 21:17:26 [DEBUG   ] Got command RPT from MCS: ref #626819
2018-11-25 21:17:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626819  77 58447 76646113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:17:26 [DEBUG   ] Got command RPT from MCS: ref #626820
2018-11-25 21:17:26 [DEBUG   ] summary = ERROR
2018-11-25 21:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626820  13 58447 76646317 A  ERRORERROR'
2018-11-25 21:17:26 [DEBUG   ] Got command RPT from MCS: ref #626821
2018-11-25 21:17:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626821  77 58447 76646521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:17:26 [DEBUG   ] Got command RPT from MCS: ref #626822
2018-11-25 21:17:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626822  12 58447 76646713 A  ERRORB¢ff'
2018-11-25 21:17:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:17:56 [DEBUG   ] Got command BAM from MCS: ref #626823
2018-11-25 21:17:56 [INFO    ] Finished processing BAM request
2018-11-25 21:17:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:17:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626823   8 58447 76676033 A  ERROR'
2018-11-25 21:17:56 [DEBUG   ] Got command BAM from MCS: ref #626824
2018-11-25 21:17:56 [INFO    ] Finished processing BAM request
2018-11-25 21:17:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:17:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626824   8 58447 76676037 A  ERROR'
2018-11-25 21:17:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:17:56 [DEBUG   ] spawn_process: at 2018-11-25 21:17:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 21:17:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:17:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:17:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:17:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:17:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:17:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:17:58 [DEBUG   ] Finished updating board flags in 1.272 seconds
2018-11-25 21:18:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:18:29 [DEBUG   ] Got command BAM from MCS: ref #626825
2018-11-25 21:18:29 [INFO    ] Finished processing BAM request
2018-11-25 21:18:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626825   8 58447 76709033 A  ERROR'
2018-11-25 21:18:29 [DEBUG   ] Got command BAM from MCS: ref #626826
2018-11-25 21:18:29 [INFO    ] Finished processing BAM request
2018-11-25 21:18:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626826   8 58447 76709037 A  ERROR'
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:18:29 [DEBUG   ] spawn_process: at 2018-11-25 21:18:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:18:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:18:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 21:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:18:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:18:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:18:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:18:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:18:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:18:58 [DEBUG   ] Finished updating board flags in 1.257 seconds
2018-11-25 21:19:02 [DEBUG   ] Got command BAM from MCS: ref #626832
2018-11-25 21:19:02 [INFO    ] Finished processing BAM request
2018-11-25 21:19:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:19:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626832   8 58447 76742025 A  ERROR'
2018-11-25 21:19:02 [DEBUG   ] Got command BAM from MCS: ref #626831
2018-11-25 21:19:02 [INFO    ] Finished processing BAM request
2018-11-25 21:19:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:19:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626831   8 58447 76742029 A  ERROR'
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:19:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:19:02 [DEBUG   ] spawn_process: at 2018-11-25 21:19:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:19:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:19:35 [DEBUG   ] Got command BAM from MCS: ref #626833
2018-11-25 21:19:35 [INFO    ] Finished processing BAM request
2018-11-25 21:19:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626833   8 58447 76775025 A  ERROR'
2018-11-25 21:19:35 [DEBUG   ] Got command BAM from MCS: ref #626834
2018-11-25 21:19:35 [INFO    ] Finished processing BAM request
2018-11-25 21:19:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626834   8 58447 76775029 A  ERROR'
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:19:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:19:35 [DEBUG   ] spawn_process: at 2018-11-25 21:19:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:19:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:19:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:19:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:19:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:19:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:19:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:19:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:19:58 [DEBUG   ] Finished updating board flags in 1.123 seconds
2018-11-25 21:20:08 [DEBUG   ] Got command BAM from MCS: ref #626836
2018-11-25 21:20:08 [INFO    ] Finished processing BAM request
2018-11-25 21:20:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626836   8 58447 76808033 A  ERROR'
2018-11-25 21:20:08 [DEBUG   ] Got command BAM from MCS: ref #626835
2018-11-25 21:20:08 [INFO    ] Finished processing BAM request
2018-11-25 21:20:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626835   8 58447 76808037 A  ERROR'
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:20:08 [DEBUG   ] spawn_process: at 2018-11-25 21:20:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:20:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:20:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:20:41 [DEBUG   ] Got command BAM from MCS: ref #626838
2018-11-25 21:20:41 [INFO    ] Finished processing BAM request
2018-11-25 21:20:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:20:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626838   8 58447 76841033 A  ERROR'
2018-11-25 21:20:41 [DEBUG   ] Got command BAM from MCS: ref #626837
2018-11-25 21:20:41 [INFO    ] Finished processing BAM request
2018-11-25 21:20:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:20:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626837   8 58447 76841037 A  ERROR'
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:20:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:20:41 [DEBUG   ] spawn_process: at 2018-11-25 21:20:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:20:48 [DEBUG   ] Got command RPT from MCS: ref #626839
2018-11-25 21:20:48 [DEBUG   ] summary = ERROR
2018-11-25 21:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626839  13 58447 76848501 A  ERRORERROR'
2018-11-25 21:20:48 [DEBUG   ] Got command RPT from MCS: ref #626840
2018-11-25 21:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626840  77 58447 76848502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:20:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:20:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:20:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:20:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:20:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:20:58 [WARNING ] (13, 1, 'bot')
2018-11-25 21:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:20:58 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-25 21:21:14 [DEBUG   ] Got command BAM from MCS: ref #626856
2018-11-25 21:21:14 [INFO    ] Finished processing BAM request
2018-11-25 21:21:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626856   8 58447 76874025 A  ERROR'
2018-11-25 21:21:14 [DEBUG   ] Got command BAM from MCS: ref #626857
2018-11-25 21:21:14 [INFO    ] Finished processing BAM request
2018-11-25 21:21:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:21:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626857   8 58447 76874029 A  ERROR'
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:21:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:21:14 [DEBUG   ] spawn_process: at 2018-11-25 21:21:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:21:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:21:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 21:21:46 [DEBUG   ] Got command BAM from MCS: ref #626862
2018-11-25 21:21:46 [INFO    ] Finished processing BAM request
2018-11-25 21:21:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626862   8 58447 76906025 A  ERROR'
2018-11-25 21:21:46 [DEBUG   ] Got command BAM from MCS: ref #626863
2018-11-25 21:21:46 [INFO    ] Finished processing BAM request
2018-11-25 21:21:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626863   8 58447 76906029 A  ERROR'
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:21:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:21:46 [DEBUG   ] spawn_process: at 2018-11-25 21:21:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:21:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 21:21:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:21:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 21:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 21:21:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2018-11-25 21:21:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:21:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:21:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:21:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:21:59 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-25 21:22:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:22:18 [DEBUG   ] Got command BAM from MCS: ref #626867
2018-11-25 21:22:18 [INFO    ] Finished processing BAM request
2018-11-25 21:22:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626867   8 58447 76938025 A  ERROR'
2018-11-25 21:22:18 [DEBUG   ] Got command BAM from MCS: ref #626866
2018-11-25 21:22:18 [INFO    ] Finished processing BAM request
2018-11-25 21:22:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:22:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626866   8 58447 76938029 A  ERROR'
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:22:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:22:18 [DEBUG   ] spawn_process: at 2018-11-25 21:22:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:22:26 [DEBUG   ] Got command RPT from MCS: ref #626868
2018-11-25 21:22:26 [DEBUG   ] summary = ERROR
2018-11-25 21:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626868  13 58447 76946001 A  ERRORERROR'
2018-11-25 21:22:26 [DEBUG   ] Got command RPT from MCS: ref #626869
2018-11-25 21:22:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626869  77 58447 76946205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:22:26 [DEBUG   ] Got command RPT from MCS: ref #626870
2018-11-25 21:22:26 [DEBUG   ] summary = ERROR
2018-11-25 21:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626870  13 58447 76946397 A  ERRORERROR'
2018-11-25 21:22:26 [DEBUG   ] Got command RPT from MCS: ref #626872
2018-11-25 21:22:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626872  77 58447 76946601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:22:26 [DEBUG   ] Got command RPT from MCS: ref #626873
2018-11-25 21:22:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:22:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626873  12 58447 76946805 A  ERRORB¡ff'
2018-11-25 21:22:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:22:50 [DEBUG   ] Got command BAM from MCS: ref #626878
2018-11-25 21:22:50 [INFO    ] Finished processing BAM request
2018-11-25 21:22:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:22:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626878   8 58447 76970025 A  ERROR'
2018-11-25 21:22:50 [DEBUG   ] Got command BAM from MCS: ref #626879
2018-11-25 21:22:50 [INFO    ] Finished processing BAM request
2018-11-25 21:22:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:22:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626879   8 58447 76970029 A  ERROR'
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:22:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:22:50 [DEBUG   ] spawn_process: at 2018-11-25 21:22:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:22:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:22:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:22:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:22:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:22:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:22:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:22:59 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-25 21:23:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:23:22 [DEBUG   ] Got command BAM from MCS: ref #626881
2018-11-25 21:23:22 [INFO    ] Finished processing BAM request
2018-11-25 21:23:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626881   8 58447 77002025 A  ERROR'
2018-11-25 21:23:22 [DEBUG   ] Got command BAM from MCS: ref #626880
2018-11-25 21:23:22 [INFO    ] Finished processing BAM request
2018-11-25 21:23:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626880   8 58447 77002029 A  ERROR'
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:23:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:23:22 [DEBUG   ] spawn_process: at 2018-11-25 21:23:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:23:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:23:54 [DEBUG   ] Got command BAM from MCS: ref #626882
2018-11-25 21:23:54 [INFO    ] Finished processing BAM request
2018-11-25 21:23:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626882   8 58447 77034029 A  ERROR'
2018-11-25 21:23:54 [DEBUG   ] Got command BAM from MCS: ref #626883
2018-11-25 21:23:54 [INFO    ] Finished processing BAM request
2018-11-25 21:23:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:23:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626883   8 58447 77034033 A  ERROR'
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:23:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:23:54 [DEBUG   ] spawn_process: at 2018-11-25 21:23:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:23:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:23:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:23:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:23:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:23:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:23:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:23:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:23:59 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-25 21:24:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:24:26 [DEBUG   ] Got command BAM from MCS: ref #626885
2018-11-25 21:24:26 [INFO    ] Finished processing BAM request
2018-11-25 21:24:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:24:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626885   8 58447 77066029 A  ERROR'
2018-11-25 21:24:26 [DEBUG   ] Got command BAM from MCS: ref #626884
2018-11-25 21:24:26 [INFO    ] Finished processing BAM request
2018-11-25 21:24:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:24:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626884   8 58447 77066033 A  ERROR'
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:24:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:24:26 [DEBUG   ] spawn_process: at 2018-11-25 21:24:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:24:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:24:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:24:58 [DEBUG   ] Got command BAM from MCS: ref #626890
2018-11-25 21:24:58 [INFO    ] Finished processing BAM request
2018-11-25 21:24:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626890   8 58447 77098037 A  ERROR'
2018-11-25 21:24:58 [DEBUG   ] Got command BAM from MCS: ref #626891
2018-11-25 21:24:58 [INFO    ] Finished processing BAM request
2018-11-25 21:24:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626891   8 58447 77098045 A  ERROR'
2018-11-25 21:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:24:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:24:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:24:58 [DEBUG   ] spawn_process: at 2018-11-25 21:24:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:24:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:24:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:24:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:24:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:24:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:24:59 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-11-25 21:25:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:25:30 [DEBUG   ] Got command BAM from MCS: ref #626892
2018-11-25 21:25:30 [INFO    ] Finished processing BAM request
2018-11-25 21:25:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626892   8 58447 77130029 A  ERROR'
2018-11-25 21:25:30 [DEBUG   ] Got command BAM from MCS: ref #626893
2018-11-25 21:25:30 [INFO    ] Finished processing BAM request
2018-11-25 21:25:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626893   8 58447 77130033 A  ERROR'
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:25:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:25:30 [DEBUG   ] spawn_process: at 2018-11-25 21:25:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:25:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:25:48 [DEBUG   ] Got command RPT from MCS: ref #626894
2018-11-25 21:25:48 [DEBUG   ] summary = ERROR
2018-11-25 21:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626894  13 58447 77148509 A  ERRORERROR'
2018-11-25 21:25:48 [DEBUG   ] Got command RPT from MCS: ref #626895
2018-11-25 21:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626895  77 58447 77148510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:25:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 21:25:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:25:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:26:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:26:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 21:26:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:26:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:26:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:26:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:26:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:26:00 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-11-25 21:26:02 [DEBUG   ] Got command BAM from MCS: ref #626911
2018-11-25 21:26:02 [INFO    ] Finished processing BAM request
2018-11-25 21:26:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626911   8 58447 77162033 A  ERROR'
2018-11-25 21:26:02 [DEBUG   ] Got command BAM from MCS: ref #626912
2018-11-25 21:26:02 [INFO    ] Finished processing BAM request
2018-11-25 21:26:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:26:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626912   8 58447 77162037 A  ERROR'
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:26:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:26:02 [DEBUG   ] spawn_process: at 2018-11-25 21:26:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:26:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:26:34 [DEBUG   ] Got command BAM from MCS: ref #626914
2018-11-25 21:26:34 [INFO    ] Finished processing BAM request
2018-11-25 21:26:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626914   8 58447 77194037 A  ERROR'
2018-11-25 21:26:34 [DEBUG   ] Got command BAM from MCS: ref #626913
2018-11-25 21:26:34 [INFO    ] Finished processing BAM request
2018-11-25 21:26:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626913   8 58447 77194045 A  ERROR'
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:26:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:26:34 [DEBUG   ] spawn_process: at 2018-11-25 21:26:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:26:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:26:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 21:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:26:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:26:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:26:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:26:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:26:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:26:59 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-11-25 21:27:06 [DEBUG   ] Got command BAM from MCS: ref #626915
2018-11-25 21:27:06 [INFO    ] Finished processing BAM request
2018-11-25 21:27:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:27:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626915   8 58447 77226033 A  ERROR'
2018-11-25 21:27:06 [DEBUG   ] Got command BAM from MCS: ref #626916
2018-11-25 21:27:06 [INFO    ] Finished processing BAM request
2018-11-25 21:27:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:27:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626916   8 58447 77226037 A  ERROR'
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:27:06 [DEBUG   ] spawn_process: at 2018-11-25 21:27:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:27:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:27:26 [DEBUG   ] Got command RPT from MCS: ref #626917
2018-11-25 21:27:26 [DEBUG   ] summary = ERROR
2018-11-25 21:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626917  13 58447 77246089 A  ERRORERROR'
2018-11-25 21:27:26 [DEBUG   ] Got command RPT from MCS: ref #626918
2018-11-25 21:27:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626918  77 58447 77246293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:27:26 [DEBUG   ] Got command RPT from MCS: ref #626919
2018-11-25 21:27:26 [DEBUG   ] summary = ERROR
2018-11-25 21:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626919  13 58447 77246485 A  ERRORERROR'
2018-11-25 21:27:26 [DEBUG   ] Got command RPT from MCS: ref #626920
2018-11-25 21:27:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626920  77 58447 77246689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:27:26 [DEBUG   ] Got command RPT from MCS: ref #626921
2018-11-25 21:27:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:27:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626921  12 58447 77246893 A  ERRORB¢ff'
2018-11-25 21:27:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:27:38 [DEBUG   ] Got command BAM from MCS: ref #626927
2018-11-25 21:27:38 [INFO    ] Finished processing BAM request
2018-11-25 21:27:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626927   8 58447 77258025 A  ERROR'
2018-11-25 21:27:38 [DEBUG   ] Got command BAM from MCS: ref #626926
2018-11-25 21:27:38 [INFO    ] Finished processing BAM request
2018-11-25 21:27:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626926   8 58447 77258029 A  ERROR'
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:27:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:27:38 [DEBUG   ] spawn_process: at 2018-11-25 21:27:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:27:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:27:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:27:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:27:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:27:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:27:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:27:59 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-11-25 21:28:10 [DEBUG   ] Got command BAM from MCS: ref #626928
2018-11-25 21:28:10 [INFO    ] Finished processing BAM request
2018-11-25 21:28:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626928   8 58447 77290025 A  ERROR'
2018-11-25 21:28:10 [DEBUG   ] Got command BAM from MCS: ref #626929
2018-11-25 21:28:10 [INFO    ] Finished processing BAM request
2018-11-25 21:28:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626929   8 58447 77290029 A  ERROR'
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:28:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:28:10 [DEBUG   ] spawn_process: at 2018-11-25 21:28:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:28:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:28:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:28:42 [DEBUG   ] Got command BAM from MCS: ref #626931
2018-11-25 21:28:42 [INFO    ] Finished processing BAM request
2018-11-25 21:28:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626931   8 58447 77322025 A  ERROR'
2018-11-25 21:28:42 [DEBUG   ] Got command BAM from MCS: ref #626930
2018-11-25 21:28:42 [INFO    ] Finished processing BAM request
2018-11-25 21:28:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:28:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626930   8 58447 77322029 A  ERROR'
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:28:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:28:42 [DEBUG   ] spawn_process: at 2018-11-25 21:28:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:28:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:28:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:28:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:28:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:28:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:28:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:28:59 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-25 21:29:14 [DEBUG   ] Got command BAM from MCS: ref #626933
2018-11-25 21:29:14 [INFO    ] Finished processing BAM request
2018-11-25 21:29:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626933   8 58447 77354029 A  ERROR'
2018-11-25 21:29:14 [DEBUG   ] Got command BAM from MCS: ref #626932
2018-11-25 21:29:14 [INFO    ] Finished processing BAM request
2018-11-25 21:29:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:29:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626932   8 58447 77354037 A  ERROR'
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:29:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:29:14 [DEBUG   ] spawn_process: at 2018-11-25 21:29:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:29:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:29:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:29:46 [DEBUG   ] Got command BAM from MCS: ref #626934
2018-11-25 21:29:46 [INFO    ] Finished processing BAM request
2018-11-25 21:29:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626934   8 58447 77386025 A  ERROR'
2018-11-25 21:29:46 [DEBUG   ] Got command BAM from MCS: ref #626935
2018-11-25 21:29:46 [INFO    ] Finished processing BAM request
2018-11-25 21:29:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626935   8 58447 77386029 A  ERROR'
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:29:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:29:46 [DEBUG   ] spawn_process: at 2018-11-25 21:29:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:29:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 21:29:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:29:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:29:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:29:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:29:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:29:59 [DEBUG   ] Finished updating board flags in 1.171 seconds
2018-11-25 21:30:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:30:18 [DEBUG   ] Got command BAM from MCS: ref #626937
2018-11-25 21:30:18 [INFO    ] Finished processing BAM request
2018-11-25 21:30:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626937   8 58447 77418033 A  ERROR'
2018-11-25 21:30:18 [DEBUG   ] Got command BAM from MCS: ref #626936
2018-11-25 21:30:18 [INFO    ] Finished processing BAM request
2018-11-25 21:30:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626936   8 58447 77418037 A  ERROR'
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:30:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:30:18 [DEBUG   ] spawn_process: at 2018-11-25 21:30:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:30:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:30:48 [DEBUG   ] Got command RPT from MCS: ref #626942
2018-11-25 21:30:48 [DEBUG   ] summary = ERROR
2018-11-25 21:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626942  13 58447 77448505 A  ERRORERROR'
2018-11-25 21:30:48 [DEBUG   ] Got command RPT from MCS: ref #626943
2018-11-25 21:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626943  77 58447 77448506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:30:50 [DEBUG   ] Got command BAM from MCS: ref #626959
2018-11-25 21:30:50 [INFO    ] Finished processing BAM request
2018-11-25 21:30:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626959   8 58447 77450033 A  ERROR'
2018-11-25 21:30:50 [DEBUG   ] Got command BAM from MCS: ref #626960
2018-11-25 21:30:50 [INFO    ] Finished processing BAM request
2018-11-25 21:30:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626960   8 58447 77450037 A  ERROR'
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:30:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:30:50 [DEBUG   ] spawn_process: at 2018-11-25 21:30:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:30:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:30:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:30:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:30:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:30:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:30:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:30:59 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-11-25 21:31:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:31:22 [DEBUG   ] Got command BAM from MCS: ref #626961
2018-11-25 21:31:22 [INFO    ] Finished processing BAM request
2018-11-25 21:31:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626961   8 58447 77482033 A  ERROR'
2018-11-25 21:31:22 [DEBUG   ] Got command BAM from MCS: ref #626962
2018-11-25 21:31:22 [INFO    ] Finished processing BAM request
2018-11-25 21:31:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:31:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626962   8 58447 77482037 A  ERROR'
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:31:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:31:22 [DEBUG   ] spawn_process: at 2018-11-25 21:31:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:31:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:31:54 [DEBUG   ] Got command BAM from MCS: ref #626963
2018-11-25 21:31:54 [INFO    ] Finished processing BAM request
2018-11-25 21:31:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626963   8 58447 77514029 A  ERROR'
2018-11-25 21:31:54 [DEBUG   ] Got command BAM from MCS: ref #626964
2018-11-25 21:31:54 [INFO    ] Finished processing BAM request
2018-11-25 21:31:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626964   8 58447 77514033 A  ERROR'
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:31:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:31:54 [DEBUG   ] spawn_process: at 2018-11-25 21:31:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:31:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:31:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:31:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:31:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:31:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:31:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:31:59 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-25 21:32:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:32:26 [DEBUG   ] Got command BAM from MCS: ref #626968
2018-11-25 21:32:26 [INFO    ] Finished processing BAM request
2018-11-25 21:32:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626968   8 58447 77546029 A  ERROR'
2018-11-25 21:32:26 [DEBUG   ] Got command BAM from MCS: ref #626967
2018-11-25 21:32:26 [INFO    ] Finished processing BAM request
2018-11-25 21:32:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626967   8 58447 77546033 A  ERROR'
2018-11-25 21:32:26 [DEBUG   ] Got command RPT from MCS: ref #626969
2018-11-25 21:32:26 [DEBUG   ] summary = ERROR
2018-11-25 21:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626969  13 58447 77546189 A  ERRORERROR'
2018-11-25 21:32:26 [DEBUG   ] Got command RPT from MCS: ref #626970
2018-11-25 21:32:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626970  77 58447 77546369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:32:26 [DEBUG   ] Got command RPT from MCS: ref #626971
2018-11-25 21:32:26 [DEBUG   ] summary = ERROR
2018-11-25 21:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626971  13 58447 77546573 A  ERRORERROR'
2018-11-25 21:32:26 [DEBUG   ] Got command RPT from MCS: ref #626973
2018-11-25 21:32:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626973  77 58447 77546777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:32:26 [DEBUG   ] spawn_process: at 2018-11-25 21:32:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:32:26 [DEBUG   ] Got command RPT from MCS: ref #626974
2018-11-25 21:32:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626974  12 58447 77546981 A  ERRORB¢ff'
2018-11-25 21:32:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:32:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:32:58 [DEBUG   ] Got command BAM from MCS: ref #626979
2018-11-25 21:32:58 [INFO    ] Finished processing BAM request
2018-11-25 21:32:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:32:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626979   8 58447 77578033 A  ERROR'
2018-11-25 21:32:58 [DEBUG   ] Got command BAM from MCS: ref #626980
2018-11-25 21:32:58 [INFO    ] Finished processing BAM request
2018-11-25 21:32:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:32:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626980   8 58447 77578037 A  ERROR'
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:32:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:32:58 [DEBUG   ] spawn_process: at 2018-11-25 21:32:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:32:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:32:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:32:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:32:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:32:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:32:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:32:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:32:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:32:59 [WARNING ] (13, 1, 'bot')
2018-11-25 21:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:32:59 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-11-25 21:33:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:33:30 [DEBUG   ] Got command BAM from MCS: ref #626982
2018-11-25 21:33:30 [INFO    ] Finished processing BAM request
2018-11-25 21:33:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626982   8 58447 77610033 A  ERROR'
2018-11-25 21:33:30 [DEBUG   ] Got command BAM from MCS: ref #626981
2018-11-25 21:33:30 [INFO    ] Finished processing BAM request
2018-11-25 21:33:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626981   8 58447 77610037 A  ERROR'
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:33:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:33:30 [DEBUG   ] spawn_process: at 2018-11-25 21:33:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:33:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:33:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:33:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:34:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:34:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:34:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:34:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:34:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:34:00 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-11-25 21:34:02 [DEBUG   ] Got command BAM from MCS: ref #626987
2018-11-25 21:34:02 [INFO    ] Finished processing BAM request
2018-11-25 21:34:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626987   8 58447 77642033 A  ERROR'
2018-11-25 21:34:02 [DEBUG   ] Got command BAM from MCS: ref #626988
2018-11-25 21:34:02 [INFO    ] Finished processing BAM request
2018-11-25 21:34:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:34:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626988   8 58447 77642037 A  ERROR'
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:34:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:34:02 [DEBUG   ] spawn_process: at 2018-11-25 21:34:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:34:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:34:34 [DEBUG   ] Got command BAM from MCS: ref #626990
2018-11-25 21:34:34 [INFO    ] Finished processing BAM request
2018-11-25 21:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626990   8 58447 77674029 A  ERROR'
2018-11-25 21:34:34 [DEBUG   ] Got command BAM from MCS: ref #626989
2018-11-25 21:34:34 [INFO    ] Finished processing BAM request
2018-11-25 21:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626989   8 58447 77674033 A  ERROR'
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:34:34 [DEBUG   ] spawn_process: at 2018-11-25 21:34:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:34:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:34:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 21:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 21:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:35:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:35:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:35:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:35:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:35:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:35:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:35:00 [DEBUG   ] Finished updating board flags in 1.341 seconds
2018-11-25 21:35:05 [DEBUG   ] Got command BAM from MCS: ref #626992
2018-11-25 21:35:05 [INFO    ] Finished processing BAM request
2018-11-25 21:35:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626992   8 58447 77705033 A  ERROR'
2018-11-25 21:35:05 [DEBUG   ] Got command BAM from MCS: ref #626991
2018-11-25 21:35:05 [INFO    ] Finished processing BAM request
2018-11-25 21:35:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626991   8 58447 77705037 A  ERROR'
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:35:05 [DEBUG   ] spawn_process: at 2018-11-25 21:35:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:35:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:35:36 [DEBUG   ] Got command BAM from MCS: ref #626993
2018-11-25 21:35:36 [INFO    ] Finished processing BAM request
2018-11-25 21:35:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626993   8 58447 77736029 A  ERROR'
2018-11-25 21:35:36 [DEBUG   ] Got command BAM from MCS: ref #626994
2018-11-25 21:35:36 [INFO    ] Finished processing BAM request
2018-11-25 21:35:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   626994   8 58447 77736033 A  ERROR'
2018-11-25 21:35:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:35:36 [DEBUG   ] spawn_process: at 2018-11-25 21:35:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:35:48 [DEBUG   ] Got command RPT from MCS: ref #626995
2018-11-25 21:35:48 [DEBUG   ] summary = ERROR
2018-11-25 21:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626995  13 58447 77748513 A  ERRORERROR'
2018-11-25 21:35:48 [DEBUG   ] Got command RPT from MCS: ref #626996
2018-11-25 21:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   626996  77 58447 77748514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:35:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:35:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:36:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:36:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:36:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:36:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:36:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:36:00 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-25 21:36:07 [DEBUG   ] Got command BAM from MCS: ref #627013
2018-11-25 21:36:07 [INFO    ] Finished processing BAM request
2018-11-25 21:36:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627013   8 58447 77767033 A  ERROR'
2018-11-25 21:36:07 [DEBUG   ] Got command BAM from MCS: ref #627012
2018-11-25 21:36:07 [INFO    ] Finished processing BAM request
2018-11-25 21:36:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627012   8 58447 77767037 A  ERROR'
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:36:07 [DEBUG   ] spawn_process: at 2018-11-25 21:36:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:36:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:36:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:36:38 [DEBUG   ] Got command BAM from MCS: ref #627019
2018-11-25 21:36:38 [INFO    ] Finished processing BAM request
2018-11-25 21:36:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627019   8 58447 77798033 A  ERROR'
2018-11-25 21:36:38 [DEBUG   ] Got command BAM from MCS: ref #627018
2018-11-25 21:36:38 [INFO    ] Finished processing BAM request
2018-11-25 21:36:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627018   8 58447 77798037 A  ERROR'
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:36:38 [DEBUG   ] spawn_process: at 2018-11-25 21:36:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:36:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:37:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:37:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:37:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:37:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:37:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:37:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:37:00 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-11-25 21:37:09 [DEBUG   ] Got command BAM from MCS: ref #627021
2018-11-25 21:37:09 [INFO    ] Finished processing BAM request
2018-11-25 21:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627021   8 58447 77829033 A  ERROR'
2018-11-25 21:37:09 [DEBUG   ] Got command BAM from MCS: ref #627020
2018-11-25 21:37:09 [INFO    ] Finished processing BAM request
2018-11-25 21:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627020   8 58447 77829037 A  ERROR'
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:37:09 [DEBUG   ] spawn_process: at 2018-11-25 21:37:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:37:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:37:26 [DEBUG   ] Got command RPT from MCS: ref #627022
2018-11-25 21:37:26 [DEBUG   ] summary = ERROR
2018-11-25 21:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627022  13 58447 77846265 A  ERRORERROR'
2018-11-25 21:37:26 [DEBUG   ] Got command RPT from MCS: ref #627023
2018-11-25 21:37:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627023  77 58447 77846458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:37:26 [DEBUG   ] Got command RPT from MCS: ref #627024
2018-11-25 21:37:26 [DEBUG   ] summary = ERROR
2018-11-25 21:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627024  13 58447 77846661 A  ERRORERROR'
2018-11-25 21:37:26 [DEBUG   ] Got command RPT from MCS: ref #627025
2018-11-25 21:37:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627025  77 58447 77846865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:37:27 [DEBUG   ] Got command RPT from MCS: ref #627026
2018-11-25 21:37:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627026  12 58447 77847058 A  ERRORB¢ff'
2018-11-25 21:37:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:37:40 [DEBUG   ] Got command BAM from MCS: ref #627027
2018-11-25 21:37:40 [INFO    ] Finished processing BAM request
2018-11-25 21:37:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627027   8 58447 77860034 A  ERROR'
2018-11-25 21:37:40 [DEBUG   ] Got command BAM from MCS: ref #627028
2018-11-25 21:37:40 [INFO    ] Finished processing BAM request
2018-11-25 21:37:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627028   8 58447 77860038 A  ERROR'
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:37:40 [DEBUG   ] spawn_process: at 2018-11-25 21:37:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:37:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-25 21:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:38:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:38:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:38:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:38:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:38:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:38:00 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-25 21:38:11 [DEBUG   ] Got command BAM from MCS: ref #627029
2018-11-25 21:38:11 [INFO    ] Finished processing BAM request
2018-11-25 21:38:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627029   8 58447 77891026 A  ERROR'
2018-11-25 21:38:11 [DEBUG   ] Got command BAM from MCS: ref #627030
2018-11-25 21:38:11 [INFO    ] Finished processing BAM request
2018-11-25 21:38:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627030   8 58447 77891030 A  ERROR'
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:38:11 [DEBUG   ] spawn_process: at 2018-11-25 21:38:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:38:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 21:38:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:38:42 [DEBUG   ] Got command BAM from MCS: ref #627031
2018-11-25 21:38:42 [INFO    ] Finished processing BAM request
2018-11-25 21:38:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627031   8 58447 77922029 A  ERROR'
2018-11-25 21:38:42 [DEBUG   ] Got command BAM from MCS: ref #627032
2018-11-25 21:38:42 [INFO    ] Finished processing BAM request
2018-11-25 21:38:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627032   8 58447 77922033 A  ERROR'
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:38:42 [DEBUG   ] spawn_process: at 2018-11-25 21:38:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:38:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:39:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:39:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 21:39:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:39:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:39:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:39:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:39:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:39:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-25 21:39:13 [DEBUG   ] Got command BAM from MCS: ref #627033
2018-11-25 21:39:13 [INFO    ] Finished processing BAM request
2018-11-25 21:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627033   8 58447 77953025 A  ERROR'
2018-11-25 21:39:13 [DEBUG   ] Got command BAM from MCS: ref #627034
2018-11-25 21:39:13 [INFO    ] Finished processing BAM request
2018-11-25 21:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627034   8 58447 77953029 A  ERROR'
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:39:13 [DEBUG   ] spawn_process: at 2018-11-25 21:39:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:39:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:39:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:39:44 [DEBUG   ] Got command BAM from MCS: ref #627039
2018-11-25 21:39:44 [INFO    ] Finished processing BAM request
2018-11-25 21:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627039   8 58447 77984033 A  ERROR'
2018-11-25 21:39:44 [DEBUG   ] Got command BAM from MCS: ref #627040
2018-11-25 21:39:44 [INFO    ] Finished processing BAM request
2018-11-25 21:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627040   8 58447 77984037 A  ERROR'
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:39:44 [DEBUG   ] spawn_process: at 2018-11-25 21:39:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:39:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 21:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:40:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 21:40:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:40:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:40:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:40:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:40:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:40:00 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-25 21:40:15 [DEBUG   ] Got command BAM from MCS: ref #627042
2018-11-25 21:40:15 [INFO    ] Finished processing BAM request
2018-11-25 21:40:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627042   8 58447 78015026 A  ERROR'
2018-11-25 21:40:15 [DEBUG   ] Got command BAM from MCS: ref #627041
2018-11-25 21:40:15 [INFO    ] Finished processing BAM request
2018-11-25 21:40:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627041   8 58447 78015030 A  ERROR'
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:40:15 [DEBUG   ] spawn_process: at 2018-11-25 21:40:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:40:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 21:40:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:40:46 [DEBUG   ] Got command BAM from MCS: ref #627043
2018-11-25 21:40:46 [INFO    ] Finished processing BAM request
2018-11-25 21:40:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:40:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627043   8 58447 78046033 A  ERROR'
2018-11-25 21:40:46 [DEBUG   ] Got command BAM from MCS: ref #627044
2018-11-25 21:40:46 [INFO    ] Finished processing BAM request
2018-11-25 21:40:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:40:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627044   8 58447 78046037 A  ERROR'
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:40:46 [DEBUG   ] spawn_process: at 2018-11-25 21:40:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:40:48 [DEBUG   ] Got command RPT from MCS: ref #627045
2018-11-25 21:40:48 [DEBUG   ] summary = ERROR
2018-11-25 21:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627045  13 58447 78048509 A  ERRORERROR'
2018-11-25 21:40:48 [DEBUG   ] Got command RPT from MCS: ref #627046
2018-11-25 21:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627046  77 58447 78048510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:40:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 21:41:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:41:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:41:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:41:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:41:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:41:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:41:00 [DEBUG   ] Finished updating board flags in 1.266 seconds
2018-11-25 21:41:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:41:17 [DEBUG   ] Got command BAM from MCS: ref #627063
2018-11-25 21:41:17 [INFO    ] Finished processing BAM request
2018-11-25 21:41:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627063   8 58447 78077025 A  ERROR'
2018-11-25 21:41:17 [DEBUG   ] Got command BAM from MCS: ref #627062
2018-11-25 21:41:17 [INFO    ] Finished processing BAM request
2018-11-25 21:41:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627062   8 58447 78077029 A  ERROR'
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:41:17 [DEBUG   ] spawn_process: at 2018-11-25 21:41:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:41:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:41:48 [DEBUG   ] Got command BAM from MCS: ref #627065
2018-11-25 21:41:48 [INFO    ] Finished processing BAM request
2018-11-25 21:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627065   8 58447 78108029 A  ERROR'
2018-11-25 21:41:48 [DEBUG   ] Got command BAM from MCS: ref #627064
2018-11-25 21:41:48 [INFO    ] Finished processing BAM request
2018-11-25 21:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627064   8 58447 78108033 A  ERROR'
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:41:48 [DEBUG   ] spawn_process: at 2018-11-25 21:41:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:41:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:42:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:42:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:42:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:42:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:42:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:42:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:42:00 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-11-25 21:42:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:42:19 [DEBUG   ] Got command BAM from MCS: ref #627068
2018-11-25 21:42:19 [INFO    ] Finished processing BAM request
2018-11-25 21:42:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627068   8 58447 78139025 A  ERROR'
2018-11-25 21:42:19 [DEBUG   ] Got command BAM from MCS: ref #627069
2018-11-25 21:42:19 [INFO    ] Finished processing BAM request
2018-11-25 21:42:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627069   8 58447 78139029 A  ERROR'
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:42:19 [DEBUG   ] spawn_process: at 2018-11-25 21:42:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:42:26 [DEBUG   ] Got command RPT from MCS: ref #627070
2018-11-25 21:42:26 [DEBUG   ] summary = ERROR
2018-11-25 21:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627070  13 58447 78146349 A  ERRORERROR'
2018-11-25 21:42:26 [DEBUG   ] Got command RPT from MCS: ref #627071
2018-11-25 21:42:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627071  77 58447 78146541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:42:26 [DEBUG   ] Got command RPT from MCS: ref #627072
2018-11-25 21:42:26 [DEBUG   ] summary = ERROR
2018-11-25 21:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627072  13 58447 78146745 A  ERRORERROR'
2018-11-25 21:42:26 [DEBUG   ] Got command RPT from MCS: ref #627074
2018-11-25 21:42:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627074  77 58447 78146949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:42:27 [DEBUG   ] Got command RPT from MCS: ref #627075
2018-11-25 21:42:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627075  12 58447 78147153 A  ERRORB¢ff'
2018-11-25 21:42:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:42:50 [DEBUG   ] Got command BAM from MCS: ref #627085
2018-11-25 21:42:50 [INFO    ] Finished processing BAM request
2018-11-25 21:42:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:42:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627085   8 58447 78170029 A  ERROR'
2018-11-25 21:42:50 [DEBUG   ] Got command BAM from MCS: ref #627084
2018-11-25 21:42:50 [INFO    ] Finished processing BAM request
2018-11-25 21:42:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:42:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627084   8 58447 78170033 A  ERROR'
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:42:50 [DEBUG   ] spawn_process: at 2018-11-25 21:42:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:42:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-25 21:43:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-25 21:43:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:43:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:43:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:43:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:43:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:43:00 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-11-25 21:43:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:43:21 [DEBUG   ] Got command BAM from MCS: ref #627087
2018-11-25 21:43:21 [INFO    ] Finished processing BAM request
2018-11-25 21:43:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627087   8 58447 78201029 A  ERROR'
2018-11-25 21:43:21 [DEBUG   ] Got command BAM from MCS: ref #627086
2018-11-25 21:43:21 [INFO    ] Finished processing BAM request
2018-11-25 21:43:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627086   8 58447 78201033 A  ERROR'
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:43:21 [DEBUG   ] spawn_process: at 2018-11-25 21:43:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:43:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 21:43:52 [DEBUG   ] Got command BAM from MCS: ref #627089
2018-11-25 21:43:52 [INFO    ] Finished processing BAM request
2018-11-25 21:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627089   8 58447 78232025 A  ERROR'
2018-11-25 21:43:52 [DEBUG   ] Got command BAM from MCS: ref #627088
2018-11-25 21:43:52 [INFO    ] Finished processing BAM request
2018-11-25 21:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627088   8 58447 78232029 A  ERROR'
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:43:52 [DEBUG   ] spawn_process: at 2018-11-25 21:43:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:43:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:44:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:44:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:44:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:44:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 21:44:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:44:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:44:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:44:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:44:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:44:00 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-11-25 21:44:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:44:23 [DEBUG   ] Got command BAM from MCS: ref #627091
2018-11-25 21:44:23 [INFO    ] Finished processing BAM request
2018-11-25 21:44:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627091   8 58447 78263025 A  ERROR'
2018-11-25 21:44:23 [DEBUG   ] Got command BAM from MCS: ref #627090
2018-11-25 21:44:23 [INFO    ] Finished processing BAM request
2018-11-25 21:44:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627090   8 58447 78263029 A  ERROR'
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:44:23 [DEBUG   ] spawn_process: at 2018-11-25 21:44:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:44:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:44:54 [DEBUG   ] Got command BAM from MCS: ref #627093
2018-11-25 21:44:54 [INFO    ] Finished processing BAM request
2018-11-25 21:44:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627093   8 58447 78294033 A  ERROR'
2018-11-25 21:44:54 [DEBUG   ] Got command BAM from MCS: ref #627092
2018-11-25 21:44:54 [INFO    ] Finished processing BAM request
2018-11-25 21:44:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627092   8 58447 78294037 A  ERROR'
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:44:54 [DEBUG   ] spawn_process: at 2018-11-25 21:44:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:44:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:45:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:45:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 21:45:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:45:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 21:45:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:45:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:45:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:45:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:45:00 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-11-25 21:45:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 21:45:25 [DEBUG   ] Got command BAM from MCS: ref #627095
2018-11-25 21:45:25 [INFO    ] Finished processing BAM request
2018-11-25 21:45:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627095   8 58447 78325029 A  ERROR'
2018-11-25 21:45:25 [DEBUG   ] Got command BAM from MCS: ref #627094
2018-11-25 21:45:25 [INFO    ] Finished processing BAM request
2018-11-25 21:45:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627094   8 58447 78325033 A  ERROR'
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:45:25 [DEBUG   ] spawn_process: at 2018-11-25 21:45:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:45:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:45:48 [DEBUG   ] Got command RPT from MCS: ref #627100
2018-11-25 21:45:48 [DEBUG   ] summary = ERROR
2018-11-25 21:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627100  13 58447 78348517 A  ERRORERROR'
2018-11-25 21:45:48 [DEBUG   ] Got command RPT from MCS: ref #627101
2018-11-25 21:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627101  77 58447 78348518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:45:56 [DEBUG   ] Got command BAM from MCS: ref #627118
2018-11-25 21:45:56 [INFO    ] Finished processing BAM request
2018-11-25 21:45:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:45:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627118   8 58447 78356025 A  ERROR'
2018-11-25 21:45:56 [DEBUG   ] Got command BAM from MCS: ref #627117
2018-11-25 21:45:56 [INFO    ] Finished processing BAM request
2018-11-25 21:45:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:45:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627117   8 58447 78356029 A  ERROR'
2018-11-25 21:45:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:45:56 [DEBUG   ] spawn_process: at 2018-11-25 21:45:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:46:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 21:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-25 21:46:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:46:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 21:46:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:46:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:46:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:46:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:46:00 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-25 21:46:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:46:27 [DEBUG   ] Got command BAM from MCS: ref #627119
2018-11-25 21:46:27 [INFO    ] Finished processing BAM request
2018-11-25 21:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627119   8 58447 78387033 A  ERROR'
2018-11-25 21:46:27 [DEBUG   ] Got command BAM from MCS: ref #627120
2018-11-25 21:46:27 [INFO    ] Finished processing BAM request
2018-11-25 21:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627120   8 58447 78387037 A  ERROR'
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:46:27 [DEBUG   ] spawn_process: at 2018-11-25 21:46:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:46:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:46:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:46:58 [DEBUG   ] Got command BAM from MCS: ref #627121
2018-11-25 21:46:58 [INFO    ] Finished processing BAM request
2018-11-25 21:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627121   8 58447 78418033 A  ERROR'
2018-11-25 21:46:58 [DEBUG   ] Got command BAM from MCS: ref #627122
2018-11-25 21:46:58 [INFO    ] Finished processing BAM request
2018-11-25 21:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627122   8 58447 78418037 A  ERROR'
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:46:58 [DEBUG   ] spawn_process: at 2018-11-25 21:46:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:47:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 21:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 21:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 21:47:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:47:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:47:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:47:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:47:00 [WARNING ] (13, 1, 'bot')
2018-11-25 21:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:47:00 [DEBUG   ] Finished updating board flags in 0.970 seconds
2018-11-25 21:47:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:47:26 [DEBUG   ] Got command RPT from MCS: ref #627123
2018-11-25 21:47:26 [DEBUG   ] summary = ERROR
2018-11-25 21:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627123  13 58447 78446437 A  ERRORERROR'
2018-11-25 21:47:26 [DEBUG   ] Got command RPT from MCS: ref #627124
2018-11-25 21:47:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627124  77 58447 78446629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:47:26 [DEBUG   ] Got command RPT from MCS: ref #627125
2018-11-25 21:47:26 [DEBUG   ] summary = ERROR
2018-11-25 21:47:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627125  13 58447 78446833 A  ERRORERROR'
2018-11-25 21:47:27 [DEBUG   ] Got command RPT from MCS: ref #627126
2018-11-25 21:47:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627126  77 58447 78447037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:47:27 [DEBUG   ] Got command RPT from MCS: ref #627127
2018-11-25 21:47:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627127  12 58447 78447241 A  ERRORB£ff'
2018-11-25 21:47:29 [DEBUG   ] Got command BAM from MCS: ref #627129
2018-11-25 21:47:29 [INFO    ] Finished processing BAM request
2018-11-25 21:47:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627129   8 58447 78449033 A  ERROR'
2018-11-25 21:47:29 [DEBUG   ] Got command BAM from MCS: ref #627128
2018-11-25 21:47:29 [INFO    ] Finished processing BAM request
2018-11-25 21:47:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627128   8 58447 78449037 A  ERROR'
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:47:29 [DEBUG   ] spawn_process: at 2018-11-25 21:47:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:47:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 21:47:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:48:00 [DEBUG   ] Got command BAM from MCS: ref #627131
2018-11-25 21:48:00 [INFO    ] Finished processing BAM request
2018-11-25 21:48:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627131   8 58447 78480029 A  ERROR'
2018-11-25 21:48:00 [DEBUG   ] Got command BAM from MCS: ref #627130
2018-11-25 21:48:00 [INFO    ] Finished processing BAM request
2018-11-25 21:48:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627130   8 58447 78480033 A  ERROR'
2018-11-25 21:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:48:00 [DEBUG   ] spawn_process: at 2018-11-25 21:48:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:48:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:48:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 21:48:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:48:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:48:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:48:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:48:01 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-25 21:48:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:48:31 [DEBUG   ] Got command BAM from MCS: ref #627132
2018-11-25 21:48:31 [INFO    ] Finished processing BAM request
2018-11-25 21:48:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627132   8 58447 78511029 A  ERROR'
2018-11-25 21:48:31 [DEBUG   ] Got command BAM from MCS: ref #627133
2018-11-25 21:48:31 [INFO    ] Finished processing BAM request
2018-11-25 21:48:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627133   8 58447 78511033 A  ERROR'
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:48:31 [DEBUG   ] spawn_process: at 2018-11-25 21:48:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:48:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:48:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:49:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:49:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 21:49:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:49:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:49:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:49:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:49:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:49:01 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-11-25 21:49:02 [DEBUG   ] Got command BAM from MCS: ref #627139
2018-11-25 21:49:02 [INFO    ] Finished processing BAM request
2018-11-25 21:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627139   8 58447 78542033 A  ERROR'
2018-11-25 21:49:02 [DEBUG   ] Got command BAM from MCS: ref #627138
2018-11-25 21:49:02 [INFO    ] Finished processing BAM request
2018-11-25 21:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627138   8 58447 78542037 A  ERROR'
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:49:02 [DEBUG   ] spawn_process: at 2018-11-25 21:49:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:49:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:49:33 [DEBUG   ] Got command BAM from MCS: ref #627141
2018-11-25 21:49:33 [INFO    ] Finished processing BAM request
2018-11-25 21:49:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627141   8 58447 78573025 A  ERROR'
2018-11-25 21:49:33 [DEBUG   ] Got command BAM from MCS: ref #627140
2018-11-25 21:49:33 [INFO    ] Finished processing BAM request
2018-11-25 21:49:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627140   8 58447 78573029 A  ERROR'
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:49:33 [DEBUG   ] spawn_process: at 2018-11-25 21:49:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:49:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:49:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 21:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 21:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:50:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:50:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:50:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:50:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:50:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:50:01 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-11-25 21:50:04 [DEBUG   ] Got command BAM from MCS: ref #627143
2018-11-25 21:50:04 [INFO    ] Finished processing BAM request
2018-11-25 21:50:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627143   8 58447 78604033 A  ERROR'
2018-11-25 21:50:04 [DEBUG   ] Got command BAM from MCS: ref #627142
2018-11-25 21:50:04 [INFO    ] Finished processing BAM request
2018-11-25 21:50:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627142   8 58447 78604037 A  ERROR'
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:50:04 [DEBUG   ] spawn_process: at 2018-11-25 21:50:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:50:16 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 21:50:35 [DEBUG   ] Got command BAM from MCS: ref #627144
2018-11-25 21:50:35 [INFO    ] Finished processing BAM request
2018-11-25 21:50:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627144   8 58447 78635025 A  ERROR'
2018-11-25 21:50:35 [DEBUG   ] Got command BAM from MCS: ref #627145
2018-11-25 21:50:35 [INFO    ] Finished processing BAM request
2018-11-25 21:50:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627145   8 58447 78635029 A  ERROR'
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:50:35 [DEBUG   ] spawn_process: at 2018-11-25 21:50:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:50:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:50:48 [DEBUG   ] Got command RPT from MCS: ref #627146
2018-11-25 21:50:48 [DEBUG   ] summary = ERROR
2018-11-25 21:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627146  13 58447 78648509 A  ERRORERROR'
2018-11-25 21:50:48 [DEBUG   ] Got command RPT from MCS: ref #627147
2018-11-25 21:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627147  77 58447 78648510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:50:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 21:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:51:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:51:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 21:51:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:51:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:51:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:51:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:51:01 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-11-25 21:51:06 [DEBUG   ] Got command BAM from MCS: ref #627163
2018-11-25 21:51:06 [INFO    ] Finished processing BAM request
2018-11-25 21:51:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627163   8 58447 78666029 A  ERROR'
2018-11-25 21:51:06 [DEBUG   ] Got command BAM from MCS: ref #627164
2018-11-25 21:51:06 [INFO    ] Finished processing BAM request
2018-11-25 21:51:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627164   8 58447 78666033 A  ERROR'
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:51:06 [DEBUG   ] spawn_process: at 2018-11-25 21:51:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:51:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-25 21:51:37 [DEBUG   ] Got command BAM from MCS: ref #627166
2018-11-25 21:51:37 [INFO    ] Finished processing BAM request
2018-11-25 21:51:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627166   8 58447 78697037 A  ERROR'
2018-11-25 21:51:37 [DEBUG   ] Got command BAM from MCS: ref #627165
2018-11-25 21:51:37 [INFO    ] Finished processing BAM request
2018-11-25 21:51:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627165   8 58447 78697045 A  ERROR'
2018-11-25 21:51:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:51:37 [DEBUG   ] spawn_process: at 2018-11-25 21:51:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:51:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 21:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:52:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:52:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 21:52:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:52:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:52:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:52:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:52:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:52:01 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-25 21:52:08 [DEBUG   ] Got command BAM from MCS: ref #627171
2018-11-25 21:52:08 [INFO    ] Finished processing BAM request
2018-11-25 21:52:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627171   8 58447 78728029 A  ERROR'
2018-11-25 21:52:08 [DEBUG   ] Got command BAM from MCS: ref #627172
2018-11-25 21:52:08 [INFO    ] Finished processing BAM request
2018-11-25 21:52:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627172   8 58447 78728033 A  ERROR'
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:52:08 [DEBUG   ] spawn_process: at 2018-11-25 21:52:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:52:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:52:26 [DEBUG   ] Got command RPT from MCS: ref #627175
2018-11-25 21:52:26 [DEBUG   ] summary = ERROR
2018-11-25 21:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627175  13 58447 78746521 A  ERRORERROR'
2018-11-25 21:52:26 [DEBUG   ] Got command RPT from MCS: ref #627176
2018-11-25 21:52:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627176  77 58447 78746713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:52:26 [DEBUG   ] Got command RPT from MCS: ref #627177
2018-11-25 21:52:26 [DEBUG   ] summary = ERROR
2018-11-25 21:52:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627177  13 58447 78746917 A  ERRORERROR'
2018-11-25 21:52:27 [DEBUG   ] Got command RPT from MCS: ref #627179
2018-11-25 21:52:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627179  77 58447 78747121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:52:27 [DEBUG   ] Got command RPT from MCS: ref #627181
2018-11-25 21:52:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627181  12 58447 78747325 A  ERRORB£ff'
2018-11-25 21:52:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:52:39 [DEBUG   ] Got command BAM from MCS: ref #627186
2018-11-25 21:52:39 [INFO    ] Finished processing BAM request
2018-11-25 21:52:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627186   8 58447 78759033 A  ERROR'
2018-11-25 21:52:39 [DEBUG   ] Got command BAM from MCS: ref #627185
2018-11-25 21:52:39 [INFO    ] Finished processing BAM request
2018-11-25 21:52:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627185   8 58447 78759037 A  ERROR'
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:52:39 [DEBUG   ] spawn_process: at 2018-11-25 21:52:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:52:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 21:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:53:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:53:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:53:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:53:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:53:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:53:01 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-11-25 21:53:10 [DEBUG   ] Got command BAM from MCS: ref #627187
2018-11-25 21:53:10 [INFO    ] Finished processing BAM request
2018-11-25 21:53:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627187   8 58447 78790029 A  ERROR'
2018-11-25 21:53:10 [DEBUG   ] Got command BAM from MCS: ref #627188
2018-11-25 21:53:10 [INFO    ] Finished processing BAM request
2018-11-25 21:53:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627188   8 58447 78790033 A  ERROR'
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:53:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:53:10 [DEBUG   ] spawn_process: at 2018-11-25 21:53:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:53:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:53:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:53:41 [DEBUG   ] Got command BAM from MCS: ref #627190
2018-11-25 21:53:41 [INFO    ] Finished processing BAM request
2018-11-25 21:53:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627190   8 58447 78821025 A  ERROR'
2018-11-25 21:53:41 [DEBUG   ] Got command BAM from MCS: ref #627189
2018-11-25 21:53:41 [INFO    ] Finished processing BAM request
2018-11-25 21:53:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:53:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627189   8 58447 78821029 A  ERROR'
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:53:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:53:41 [DEBUG   ] spawn_process: at 2018-11-25 21:53:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:53:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:54:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 21:54:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:54:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 21:54:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:54:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:54:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:54:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:54:01 [DEBUG   ] Finished updating board flags in 1.262 seconds
2018-11-25 21:54:12 [DEBUG   ] Got command BAM from MCS: ref #627191
2018-11-25 21:54:12 [INFO    ] Finished processing BAM request
2018-11-25 21:54:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627191   8 58447 78852025 A  ERROR'
2018-11-25 21:54:12 [DEBUG   ] Got command BAM from MCS: ref #627192
2018-11-25 21:54:12 [INFO    ] Finished processing BAM request
2018-11-25 21:54:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627192   8 58447 78852029 A  ERROR'
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:54:12 [DEBUG   ] spawn_process: at 2018-11-25 21:54:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:54:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:54:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:54:43 [DEBUG   ] Got command BAM from MCS: ref #627197
2018-11-25 21:54:43 [INFO    ] Finished processing BAM request
2018-11-25 21:54:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:54:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627197   8 58447 78883029 A  ERROR'
2018-11-25 21:54:43 [DEBUG   ] Got command BAM from MCS: ref #627198
2018-11-25 21:54:43 [INFO    ] Finished processing BAM request
2018-11-25 21:54:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:54:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627198   8 58447 78883033 A  ERROR'
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 21:54:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 21:54:43 [DEBUG   ] spawn_process: at 2018-11-25 21:54:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 21:54:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:55:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:55:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:55:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:55:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:55:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:55:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:55:01 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-11-25 21:55:14 [DEBUG   ] Got command BAM from MCS: ref #627199
2018-11-25 21:55:14 [INFO    ] Finished processing BAM request
2018-11-25 21:55:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627199   8 58447 78914033 A  ERROR'
2018-11-25 21:55:14 [DEBUG   ] Got command BAM from MCS: ref #627200
2018-11-25 21:55:14 [INFO    ] Finished processing BAM request
2018-11-25 21:55:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627200   8 58447 78914041 A  ERROR'
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:55:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:55:14 [DEBUG   ] spawn_process: at 2018-11-25 21:55:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:55:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 21:55:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:55:45 [DEBUG   ] Got command BAM from MCS: ref #627201
2018-11-25 21:55:45 [INFO    ] Finished processing BAM request
2018-11-25 21:55:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627201   8 58447 78945033 A  ERROR'
2018-11-25 21:55:45 [DEBUG   ] Got command BAM from MCS: ref #627202
2018-11-25 21:55:45 [INFO    ] Finished processing BAM request
2018-11-25 21:55:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627202   8 58447 78945037 A  ERROR'
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:55:45 [DEBUG   ] spawn_process: at 2018-11-25 21:55:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:55:48 [DEBUG   ] Got command RPT from MCS: ref #627203
2018-11-25 21:55:48 [DEBUG   ] summary = ERROR
2018-11-25 21:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627203  13 58447 78948517 A  ERRORERROR'
2018-11-25 21:55:48 [DEBUG   ] Got command RPT from MCS: ref #627204
2018-11-25 21:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627204  77 58447 78948518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:55:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-25 21:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:56:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:56:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:56:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:56:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:56:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:56:01 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-25 21:56:16 [DEBUG   ] Got command BAM from MCS: ref #627221
2018-11-25 21:56:16 [INFO    ] Finished processing BAM request
2018-11-25 21:56:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627221   8 58447 78976033 A  ERROR'
2018-11-25 21:56:16 [DEBUG   ] Got command BAM from MCS: ref #627220
2018-11-25 21:56:16 [INFO    ] Finished processing BAM request
2018-11-25 21:56:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:56:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627220   8 58447 78976037 A  ERROR'
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:56:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:56:16 [DEBUG   ] spawn_process: at 2018-11-25 21:56:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:56:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 21:56:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:56:47 [DEBUG   ] Got command BAM from MCS: ref #627222
2018-11-25 21:56:47 [INFO    ] Finished processing BAM request
2018-11-25 21:56:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627222   8 58447 79007033 A  ERROR'
2018-11-25 21:56:47 [DEBUG   ] Got command BAM from MCS: ref #627223
2018-11-25 21:56:47 [INFO    ] Finished processing BAM request
2018-11-25 21:56:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627223   8 58447 79007037 A  ERROR'
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:56:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:56:47 [DEBUG   ] spawn_process: at 2018-11-25 21:56:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:56:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:57:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 21:57:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:57:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:57:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:57:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:57:01 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-11-25 21:57:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:57:18 [DEBUG   ] Got command BAM from MCS: ref #627225
2018-11-25 21:57:18 [INFO    ] Finished processing BAM request
2018-11-25 21:57:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627225   8 58447 79038033 A  ERROR'
2018-11-25 21:57:18 [DEBUG   ] Got command BAM from MCS: ref #627224
2018-11-25 21:57:18 [INFO    ] Finished processing BAM request
2018-11-25 21:57:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:57:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627224   8 58447 79038037 A  ERROR'
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:57:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:57:18 [DEBUG   ] spawn_process: at 2018-11-25 21:57:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:57:26 [DEBUG   ] Got command RPT from MCS: ref #627226
2018-11-25 21:57:26 [DEBUG   ] summary = ERROR
2018-11-25 21:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627226  13 58447 79046597 A  ERRORERROR'
2018-11-25 21:57:26 [DEBUG   ] Got command RPT from MCS: ref #627227
2018-11-25 21:57:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:57:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627227  77 58447 79046801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:57:27 [DEBUG   ] Got command RPT from MCS: ref #627228
2018-11-25 21:57:27 [DEBUG   ] summary = ERROR
2018-11-25 21:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627228  13 58447 79047005 A  ERRORERROR'
2018-11-25 21:57:27 [DEBUG   ] Got command RPT from MCS: ref #627229
2018-11-25 21:57:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 21:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627229  77 58447 79047209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 21:57:27 [DEBUG   ] Got command RPT from MCS: ref #627230
2018-11-25 21:57:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 21:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627230  12 58447 79047401 A  ERRORB£ff'
2018-11-25 21:57:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:57:49 [DEBUG   ] Got command BAM from MCS: ref #627236
2018-11-25 21:57:49 [INFO    ] Finished processing BAM request
2018-11-25 21:57:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:57:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627236   8 58447 79069025 A  ERROR'
2018-11-25 21:57:49 [DEBUG   ] Got command BAM from MCS: ref #627235
2018-11-25 21:57:49 [INFO    ] Finished processing BAM request
2018-11-25 21:57:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:57:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627235   8 58447 79069029 A  ERROR'
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:57:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:57:49 [DEBUG   ] spawn_process: at 2018-11-25 21:57:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:57:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:58:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:58:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 21:58:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:58:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:58:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:58:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:58:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:58:01 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-25 21:58:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 21:58:20 [DEBUG   ] Got command BAM from MCS: ref #627238
2018-11-25 21:58:20 [INFO    ] Finished processing BAM request
2018-11-25 21:58:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627238   8 58447 79100029 A  ERROR'
2018-11-25 21:58:20 [DEBUG   ] Got command BAM from MCS: ref #627237
2018-11-25 21:58:20 [INFO    ] Finished processing BAM request
2018-11-25 21:58:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627237   8 58447 79100033 A  ERROR'
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 21:58:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 21:58:20 [DEBUG   ] spawn_process: at 2018-11-25 21:58:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 21:58:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 21:58:51 [DEBUG   ] Got command BAM from MCS: ref #627239
2018-11-25 21:58:51 [INFO    ] Finished processing BAM request
2018-11-25 21:58:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627239   8 58447 79131025 A  ERROR'
2018-11-25 21:58:51 [DEBUG   ] Got command BAM from MCS: ref #627240
2018-11-25 21:58:51 [INFO    ] Finished processing BAM request
2018-11-25 21:58:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627240   8 58447 79131029 A  ERROR'
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 21:58:51 [DEBUG   ] spawn_process: at 2018-11-25 21:58:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 21:58:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 21:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 21:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 21:59:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 21:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 21:59:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:59:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:59:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:59:01 [WARNING ] (13, 1, 'bot')
2018-11-25 21:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 21:59:01 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-11-25 21:59:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:59:22 [DEBUG   ] Got command BAM from MCS: ref #627241
2018-11-25 21:59:22 [INFO    ] Finished processing BAM request
2018-11-25 21:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627241   8 58447 79162033 A  ERROR'
2018-11-25 21:59:22 [DEBUG   ] Got command BAM from MCS: ref #627242
2018-11-25 21:59:22 [INFO    ] Finished processing BAM request
2018-11-25 21:59:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627242   8 58447 79162037 A  ERROR'
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 21:59:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 21:59:22 [DEBUG   ] spawn_process: at 2018-11-25 21:59:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 21:59:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 21:59:53 [DEBUG   ] Got command BAM from MCS: ref #627243
2018-11-25 21:59:53 [INFO    ] Finished processing BAM request
2018-11-25 21:59:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627243   8 58447 79193029 A  ERROR'
2018-11-25 21:59:53 [DEBUG   ] Got command BAM from MCS: ref #627244
2018-11-25 21:59:53 [INFO    ] Finished processing BAM request
2018-11-25 21:59:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 21:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627244   8 58447 79193033 A  ERROR'
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 21:59:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 21:59:53 [DEBUG   ] spawn_process: at 2018-11-25 21:59:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 21:59:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 22:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-25 22:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 22:00:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:00:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:00:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:00:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:00:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:00:02 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-11-25 22:00:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 22:00:24 [DEBUG   ] Got command BAM from MCS: ref #627245
2018-11-25 22:00:24 [INFO    ] Finished processing BAM request
2018-11-25 22:00:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627245   8 58447 79224037 A  ERROR'
2018-11-25 22:00:24 [DEBUG   ] Got command BAM from MCS: ref #627246
2018-11-25 22:00:24 [INFO    ] Finished processing BAM request
2018-11-25 22:00:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:00:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627246   8 58447 79224041 A  ERROR'
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:00:25 [DEBUG   ] spawn_process: at 2018-11-25 22:00:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:00:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:00:48 [DEBUG   ] Got command RPT from MCS: ref #627251
2018-11-25 22:00:48 [DEBUG   ] summary = ERROR
2018-11-25 22:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627251  13 58447 79248517 A  ERRORERROR'
2018-11-25 22:00:48 [DEBUG   ] Got command RPT from MCS: ref #627252
2018-11-25 22:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627252  77 58447 79248518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:00:55 [DEBUG   ] Got command BAM from MCS: ref #627269
2018-11-25 22:00:55 [INFO    ] Finished processing BAM request
2018-11-25 22:00:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:00:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627269   8 58447 79255025 A  ERROR'
2018-11-25 22:00:55 [DEBUG   ] Got command BAM from MCS: ref #627268
2018-11-25 22:00:55 [INFO    ] Finished processing BAM request
2018-11-25 22:00:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:00:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627268   8 58447 79255029 A  ERROR'
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:00:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:00:55 [DEBUG   ] spawn_process: at 2018-11-25 22:00:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:00:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 22:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:01:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:01:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:01:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:01:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:01:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:01:02 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-11-25 22:01:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 22:01:26 [DEBUG   ] Got command BAM from MCS: ref #627271
2018-11-25 22:01:26 [INFO    ] Finished processing BAM request
2018-11-25 22:01:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627271   8 58447 79286025 A  ERROR'
2018-11-25 22:01:26 [DEBUG   ] Got command BAM from MCS: ref #627270
2018-11-25 22:01:26 [INFO    ] Finished processing BAM request
2018-11-25 22:01:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:01:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627270   8 58447 79286029 A  ERROR'
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:01:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:01:26 [DEBUG   ] spawn_process: at 2018-11-25 22:01:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:01:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 22:01:57 [DEBUG   ] Got command BAM from MCS: ref #627272
2018-11-25 22:01:57 [INFO    ] Finished processing BAM request
2018-11-25 22:01:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627272   8 58447 79317025 A  ERROR'
2018-11-25 22:01:57 [DEBUG   ] Got command BAM from MCS: ref #627273
2018-11-25 22:01:57 [INFO    ] Finished processing BAM request
2018-11-25 22:01:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627273   8 58447 79317029 A  ERROR'
2018-11-25 22:01:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:01:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:01:57 [DEBUG   ] spawn_process: at 2018-11-25 22:01:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:02:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 22:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:02:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:02:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:02:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:02:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:02:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:02:02 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-25 22:02:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 22:02:26 [DEBUG   ] Got command RPT from MCS: ref #627276
2018-11-25 22:02:26 [DEBUG   ] summary = ERROR
2018-11-25 22:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627276  13 58447 79346685 A  ERRORERROR'
2018-11-25 22:02:26 [DEBUG   ] Got command RPT from MCS: ref #627277
2018-11-25 22:02:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:02:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627277  77 58447 79346889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:02:27 [DEBUG   ] Got command RPT from MCS: ref #627280
2018-11-25 22:02:27 [DEBUG   ] summary = ERROR
2018-11-25 22:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627280  13 58447 79347093 A  ERRORERROR'
2018-11-25 22:02:27 [DEBUG   ] Got command RPT from MCS: ref #627282
2018-11-25 22:02:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627282  77 58447 79347285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:02:27 [DEBUG   ] Got command RPT from MCS: ref #627283
2018-11-25 22:02:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627283  12 58447 79347489 A  ERRORB¢ff'
2018-11-25 22:02:28 [DEBUG   ] Got command BAM from MCS: ref #627279
2018-11-25 22:02:28 [INFO    ] Finished processing BAM request
2018-11-25 22:02:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627279   8 58447 79348033 A  ERROR'
2018-11-25 22:02:28 [DEBUG   ] Got command BAM from MCS: ref #627278
2018-11-25 22:02:28 [INFO    ] Finished processing BAM request
2018-11-25 22:02:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627278   8 58447 79348037 A  ERROR'
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:02:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:02:28 [DEBUG   ] spawn_process: at 2018-11-25 22:02:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:02:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 22:02:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:02:59 [DEBUG   ] Got command BAM from MCS: ref #627288
2018-11-25 22:02:59 [INFO    ] Finished processing BAM request
2018-11-25 22:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627288   8 58447 79379025 A  ERROR'
2018-11-25 22:02:59 [DEBUG   ] Got command BAM from MCS: ref #627289
2018-11-25 22:02:59 [INFO    ] Finished processing BAM request
2018-11-25 22:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627289   8 58447 79379029 A  ERROR'
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:02:59 [DEBUG   ] spawn_process: at 2018-11-25 22:02:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 22:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 22:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 22:03:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:03:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:03:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:03:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:03:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:03:02 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-25 22:03:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:03:30 [DEBUG   ] Got command BAM from MCS: ref #627291
2018-11-25 22:03:30 [INFO    ] Finished processing BAM request
2018-11-25 22:03:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627291   8 58447 79410033 A  ERROR'
2018-11-25 22:03:30 [DEBUG   ] Got command BAM from MCS: ref #627290
2018-11-25 22:03:30 [INFO    ] Finished processing BAM request
2018-11-25 22:03:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627290   8 58447 79410037 A  ERROR'
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:03:30 [DEBUG   ] spawn_process: at 2018-11-25 22:03:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:03:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:03:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:04:01 [DEBUG   ] Got command BAM from MCS: ref #627297
2018-11-25 22:04:01 [INFO    ] Finished processing BAM request
2018-11-25 22:04:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627297   8 58447 79441029 A  ERROR'
2018-11-25 22:04:01 [DEBUG   ] Got command BAM from MCS: ref #627296
2018-11-25 22:04:01 [INFO    ] Finished processing BAM request
2018-11-25 22:04:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627296   8 58447 79441033 A  ERROR'
2018-11-25 22:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:04:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:04:01 [DEBUG   ] spawn_process: at 2018-11-25 22:04:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:04:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:04:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:04:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:04:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:04:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:04:02 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-11-25 22:04:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:04:32 [DEBUG   ] Got command BAM from MCS: ref #627298
2018-11-25 22:04:32 [INFO    ] Finished processing BAM request
2018-11-25 22:04:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627298   8 58447 79472033 A  ERROR'
2018-11-25 22:04:32 [DEBUG   ] Got command BAM from MCS: ref #627299
2018-11-25 22:04:32 [INFO    ] Finished processing BAM request
2018-11-25 22:04:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627299   8 58447 79472037 A  ERROR'
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:04:32 [DEBUG   ] spawn_process: at 2018-11-25 22:04:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:04:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:04:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 22:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:05:03 [DEBUG   ] Got command BAM from MCS: ref #627300
2018-11-25 22:05:03 [INFO    ] Finished processing BAM request
2018-11-25 22:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627300   8 58447 79503029 A  ERROR'
2018-11-25 22:05:03 [DEBUG   ] Got command BAM from MCS: ref #627301
2018-11-25 22:05:03 [INFO    ] Finished processing BAM request
2018-11-25 22:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627301   8 58447 79503033 A  ERROR'
2018-11-25 22:05:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:05:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:05:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:05:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:05:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:05:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:05:03 [DEBUG   ] Finished updating board flags in 1.883 seconds
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:05:03 [DEBUG   ] spawn_process: at 2018-11-25 22:05:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:05:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:05:34 [DEBUG   ] Got command BAM from MCS: ref #627302
2018-11-25 22:05:34 [INFO    ] Finished processing BAM request
2018-11-25 22:05:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:05:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627302   8 58447 79534033 A  ERROR'
2018-11-25 22:05:34 [DEBUG   ] Got command BAM from MCS: ref #627303
2018-11-25 22:05:34 [INFO    ] Finished processing BAM request
2018-11-25 22:05:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:05:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627303   8 58447 79534037 A  ERROR'
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:05:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:05:34 [DEBUG   ] spawn_process: at 2018-11-25 22:05:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:05:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:05:48 [DEBUG   ] Got command RPT from MCS: ref #627304
2018-11-25 22:05:48 [DEBUG   ] summary = ERROR
2018-11-25 22:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627304  13 58447 79548521 A  ERRORERROR'
2018-11-25 22:05:48 [DEBUG   ] Got command RPT from MCS: ref #627305
2018-11-25 22:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627305  77 58447 79548522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:05:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:06:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:06:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:06:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:06:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:06:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:06:02 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-11-25 22:06:05 [DEBUG   ] Got command BAM from MCS: ref #627321
2018-11-25 22:06:05 [INFO    ] Finished processing BAM request
2018-11-25 22:06:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627321   8 58447 79565029 A  ERROR'
2018-11-25 22:06:05 [DEBUG   ] Got command BAM from MCS: ref #627322
2018-11-25 22:06:05 [INFO    ] Finished processing BAM request
2018-11-25 22:06:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627322   8 58447 79565033 A  ERROR'
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:06:05 [DEBUG   ] spawn_process: at 2018-11-25 22:06:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:06:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:06:36 [DEBUG   ] Got command BAM from MCS: ref #627323
2018-11-25 22:06:36 [INFO    ] Finished processing BAM request
2018-11-25 22:06:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627323   8 58447 79596025 A  ERROR'
2018-11-25 22:06:36 [DEBUG   ] Got command BAM from MCS: ref #627324
2018-11-25 22:06:36 [INFO    ] Finished processing BAM request
2018-11-25 22:06:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627324   8 58447 79596029 A  ERROR'
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:06:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:06:36 [DEBUG   ] spawn_process: at 2018-11-25 22:06:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:06:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 22:06:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:07:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:07:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:07:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:07:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:07:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:07:02 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-25 22:07:07 [DEBUG   ] Got command BAM from MCS: ref #627330
2018-11-25 22:07:07 [INFO    ] Finished processing BAM request
2018-11-25 22:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627330   8 58447 79627033 A  ERROR'
2018-11-25 22:07:07 [DEBUG   ] Got command BAM from MCS: ref #627329
2018-11-25 22:07:07 [INFO    ] Finished processing BAM request
2018-11-25 22:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627329   8 58447 79627037 A  ERROR'
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:07:07 [DEBUG   ] spawn_process: at 2018-11-25 22:07:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:07:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 22:07:26 [DEBUG   ] Got command RPT from MCS: ref #627331
2018-11-25 22:07:26 [DEBUG   ] summary = ERROR
2018-11-25 22:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627331  13 58447 79646793 A  ERRORERROR'
2018-11-25 22:07:26 [DEBUG   ] Got command RPT from MCS: ref #627332
2018-11-25 22:07:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627332  77 58447 79646985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:07:27 [DEBUG   ] Got command RPT from MCS: ref #627333
2018-11-25 22:07:27 [DEBUG   ] summary = ERROR
2018-11-25 22:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627333  13 58447 79647189 A  ERRORERROR'
2018-11-25 22:07:27 [DEBUG   ] Got command RPT from MCS: ref #627334
2018-11-25 22:07:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627334  77 58447 79647393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:07:27 [DEBUG   ] Got command RPT from MCS: ref #627335
2018-11-25 22:07:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627335  12 58447 79647597 A  ERRORB¢ff'
2018-11-25 22:07:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:07:38 [DEBUG   ] Got command BAM from MCS: ref #627336
2018-11-25 22:07:38 [INFO    ] Finished processing BAM request
2018-11-25 22:07:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627336   8 58447 79658029 A  ERROR'
2018-11-25 22:07:38 [DEBUG   ] Got command BAM from MCS: ref #627337
2018-11-25 22:07:38 [INFO    ] Finished processing BAM request
2018-11-25 22:07:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627337   8 58447 79658033 A  ERROR'
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:07:38 [DEBUG   ] spawn_process: at 2018-11-25 22:07:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:07:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:08:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 22:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:08:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:08:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:08:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:08:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:08:02 [WARNING ] (13, 1, 'bot')
2018-11-25 22:08:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:08:02 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-11-25 22:08:09 [DEBUG   ] Got command BAM from MCS: ref #627338
2018-11-25 22:08:09 [INFO    ] Finished processing BAM request
2018-11-25 22:08:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:08:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627338   8 58447 79689033 A  ERROR'
2018-11-25 22:08:09 [DEBUG   ] Got command BAM from MCS: ref #627339
2018-11-25 22:08:09 [INFO    ] Finished processing BAM request
2018-11-25 22:08:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:08:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627339   8 58447 79689037 A  ERROR'
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:08:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:08:09 [DEBUG   ] spawn_process: at 2018-11-25 22:08:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:08:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:08:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:08:40 [DEBUG   ] Got command BAM from MCS: ref #627340
2018-11-25 22:08:40 [INFO    ] Finished processing BAM request
2018-11-25 22:08:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627340   8 58447 79720025 A  ERROR'
2018-11-25 22:08:40 [DEBUG   ] Got command BAM from MCS: ref #627341
2018-11-25 22:08:40 [INFO    ] Finished processing BAM request
2018-11-25 22:08:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627341   8 58447 79720029 A  ERROR'
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:08:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:08:40 [DEBUG   ] spawn_process: at 2018-11-25 22:08:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:08:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:09:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:09:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:09:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:09:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:09:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:09:03 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-11-25 22:09:11 [DEBUG   ] Got command BAM from MCS: ref #627343
2018-11-25 22:09:11 [INFO    ] Finished processing BAM request
2018-11-25 22:09:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627343   8 58447 79751025 A  ERROR'
2018-11-25 22:09:11 [DEBUG   ] Got command BAM from MCS: ref #627342
2018-11-25 22:09:11 [INFO    ] Finished processing BAM request
2018-11-25 22:09:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:09:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627342   8 58447 79751029 A  ERROR'
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:09:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:09:11 [DEBUG   ] spawn_process: at 2018-11-25 22:09:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:09:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:09:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:09:42 [DEBUG   ] Got command BAM from MCS: ref #627349
2018-11-25 22:09:42 [INFO    ] Finished processing BAM request
2018-11-25 22:09:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627349   8 58447 79782029 A  ERROR'
2018-11-25 22:09:42 [DEBUG   ] Got command BAM from MCS: ref #627348
2018-11-25 22:09:42 [INFO    ] Finished processing BAM request
2018-11-25 22:09:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627348   8 58447 79782033 A  ERROR'
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:09:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:09:42 [DEBUG   ] spawn_process: at 2018-11-25 22:09:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:09:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:10:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 22:10:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:10:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:10:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:10:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:10:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:10:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:10:03 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-25 22:10:13 [DEBUG   ] Got command BAM from MCS: ref #627350
2018-11-25 22:10:13 [INFO    ] Finished processing BAM request
2018-11-25 22:10:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627350   8 58447 79813025 A  ERROR'
2018-11-25 22:10:13 [DEBUG   ] Got command BAM from MCS: ref #627351
2018-11-25 22:10:13 [INFO    ] Finished processing BAM request
2018-11-25 22:10:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627351   8 58447 79813029 A  ERROR'
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:10:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:10:13 [DEBUG   ] spawn_process: at 2018-11-25 22:10:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:10:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 22:10:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:10:44 [DEBUG   ] Got command BAM from MCS: ref #627352
2018-11-25 22:10:44 [INFO    ] Finished processing BAM request
2018-11-25 22:10:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627352   8 58447 79844033 A  ERROR'
2018-11-25 22:10:44 [DEBUG   ] Got command BAM from MCS: ref #627353
2018-11-25 22:10:44 [INFO    ] Finished processing BAM request
2018-11-25 22:10:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627353   8 58447 79844037 A  ERROR'
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:10:44 [DEBUG   ] spawn_process: at 2018-11-25 22:10:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:10:48 [DEBUG   ] Got command RPT from MCS: ref #627354
2018-11-25 22:10:48 [DEBUG   ] summary = ERROR
2018-11-25 22:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627354  13 58447 79848513 A  ERRORERROR'
2018-11-25 22:10:48 [DEBUG   ] Got command RPT from MCS: ref #627355
2018-11-25 22:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627355  77 58447 79848514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:10:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 22:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:11:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-25 22:11:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:11:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:11:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:11:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:11:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:11:03 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-25 22:11:15 [DEBUG   ] Got command BAM from MCS: ref #627371
2018-11-25 22:11:15 [INFO    ] Finished processing BAM request
2018-11-25 22:11:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627371   8 58447 79875025 A  ERROR'
2018-11-25 22:11:15 [DEBUG   ] Got command BAM from MCS: ref #627372
2018-11-25 22:11:15 [INFO    ] Finished processing BAM request
2018-11-25 22:11:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627372   8 58447 79875029 A  ERROR'
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:11:15 [DEBUG   ] spawn_process: at 2018-11-25 22:11:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:11:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:11:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:11:46 [DEBUG   ] Got command BAM from MCS: ref #627373
2018-11-25 22:11:46 [INFO    ] Finished processing BAM request
2018-11-25 22:11:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627373   8 58447 79906025 A  ERROR'
2018-11-25 22:11:46 [DEBUG   ] Got command BAM from MCS: ref #627374
2018-11-25 22:11:46 [INFO    ] Finished processing BAM request
2018-11-25 22:11:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627374   8 58447 79906029 A  ERROR'
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:11:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:11:46 [DEBUG   ] spawn_process: at 2018-11-25 22:11:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:11:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:12:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-25 22:12:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:12:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:12:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:12:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:12:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:12:03 [DEBUG   ] Finished updating board flags in 1.258 seconds
2018-11-25 22:12:17 [DEBUG   ] Got command BAM from MCS: ref #627378
2018-11-25 22:12:17 [INFO    ] Finished processing BAM request
2018-11-25 22:12:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627378   8 58447 79937033 A  ERROR'
2018-11-25 22:12:17 [DEBUG   ] Got command BAM from MCS: ref #627377
2018-11-25 22:12:17 [INFO    ] Finished processing BAM request
2018-11-25 22:12:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:12:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627377   8 58447 79937037 A  ERROR'
2018-11-25 22:12:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:12:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:12:17 [DEBUG   ] spawn_process: at 2018-11-25 22:12:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:12:26 [DEBUG   ] Got command RPT from MCS: ref #627379
2018-11-25 22:12:26 [DEBUG   ] summary = ERROR
2018-11-25 22:12:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627379  13 58447 79946873 A  ERRORERROR'
2018-11-25 22:12:27 [DEBUG   ] Got command RPT from MCS: ref #627380
2018-11-25 22:12:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627380  77 58447 79947077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:12:27 [DEBUG   ] Got command RPT from MCS: ref #627381
2018-11-25 22:12:27 [DEBUG   ] summary = ERROR
2018-11-25 22:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627381  13 58447 79947281 A  ERRORERROR'
2018-11-25 22:12:27 [DEBUG   ] Got command RPT from MCS: ref #627383
2018-11-25 22:12:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627383  77 58447 79947473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:12:27 [DEBUG   ] Got command RPT from MCS: ref #627384
2018-11-25 22:12:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627384  12 58447 79947677 A  ERRORB¢ff'
2018-11-25 22:12:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 22:12:48 [DEBUG   ] Got command BAM from MCS: ref #627393
2018-11-25 22:12:48 [INFO    ] Finished processing BAM request
2018-11-25 22:12:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:12:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627393   8 58447 79968025 A  ERROR'
2018-11-25 22:12:48 [DEBUG   ] Got command BAM from MCS: ref #627394
2018-11-25 22:12:48 [INFO    ] Finished processing BAM request
2018-11-25 22:12:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:12:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627394   8 58447 79968029 A  ERROR'
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:12:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:12:48 [DEBUG   ] spawn_process: at 2018-11-25 22:12:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:12:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 22:13:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:13:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:13:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:13:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:13:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:13:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:13:03 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-11-25 22:13:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:13:19 [DEBUG   ] Got command BAM from MCS: ref #627395
2018-11-25 22:13:19 [INFO    ] Finished processing BAM request
2018-11-25 22:13:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627395   8 58447 79999029 A  ERROR'
2018-11-25 22:13:19 [DEBUG   ] Got command BAM from MCS: ref #627396
2018-11-25 22:13:19 [INFO    ] Finished processing BAM request
2018-11-25 22:13:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627396   8 58447 79999033 A  ERROR'
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:13:19 [DEBUG   ] spawn_process: at 2018-11-25 22:13:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:13:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:13:50 [DEBUG   ] Got command BAM from MCS: ref #627398
2018-11-25 22:13:50 [INFO    ] Finished processing BAM request
2018-11-25 22:13:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627398   8 58447 80030025 A  ERROR'
2018-11-25 22:13:50 [DEBUG   ] Got command BAM from MCS: ref #627397
2018-11-25 22:13:50 [INFO    ] Finished processing BAM request
2018-11-25 22:13:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627397   8 58447 80030029 A  ERROR'
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:13:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:13:50 [DEBUG   ] spawn_process: at 2018-11-25 22:13:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:13:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 22:14:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:14:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:14:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:14:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:14:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:14:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:14:03 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-25 22:14:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-25 22:14:21 [DEBUG   ] Got command BAM from MCS: ref #627399
2018-11-25 22:14:21 [INFO    ] Finished processing BAM request
2018-11-25 22:14:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627399   8 58447 80061033 A  ERROR'
2018-11-25 22:14:21 [DEBUG   ] Got command BAM from MCS: ref #627400
2018-11-25 22:14:21 [INFO    ] Finished processing BAM request
2018-11-25 22:14:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627400   8 58447 80061037 A  ERROR'
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:14:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:14:21 [DEBUG   ] spawn_process: at 2018-11-25 22:14:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:14:37 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 22:14:52 [DEBUG   ] Got command BAM from MCS: ref #627401
2018-11-25 22:14:52 [INFO    ] Finished processing BAM request
2018-11-25 22:14:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627401   8 58447 80092029 A  ERROR'
2018-11-25 22:14:52 [DEBUG   ] Got command BAM from MCS: ref #627402
2018-11-25 22:14:52 [INFO    ] Finished processing BAM request
2018-11-25 22:14:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627402   8 58447 80092033 A  ERROR'
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:14:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:14:52 [DEBUG   ] spawn_process: at 2018-11-25 22:14:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:14:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:15:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 22:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:15:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 22:15:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:15:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:15:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:15:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:15:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:15:03 [WARNING ] (13, 1, 'bot')
2018-11-25 22:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:15:03 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-11-25 22:15:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:15:23 [DEBUG   ] Got command BAM from MCS: ref #627404
2018-11-25 22:15:23 [INFO    ] Finished processing BAM request
2018-11-25 22:15:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627404   8 58447 80123025 A  ERROR'
2018-11-25 22:15:23 [DEBUG   ] Got command BAM from MCS: ref #627403
2018-11-25 22:15:23 [INFO    ] Finished processing BAM request
2018-11-25 22:15:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627403   8 58447 80123029 A  ERROR'
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:15:23 [DEBUG   ] spawn_process: at 2018-11-25 22:15:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:15:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:15:48 [DEBUG   ] Got command RPT from MCS: ref #627409
2018-11-25 22:15:48 [DEBUG   ] summary = ERROR
2018-11-25 22:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627409  13 58447 80148517 A  ERRORERROR'
2018-11-25 22:15:48 [DEBUG   ] Got command RPT from MCS: ref #627410
2018-11-25 22:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627410  77 58447 80148518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:15:54 [DEBUG   ] Got command BAM from MCS: ref #627426
2018-11-25 22:15:54 [INFO    ] Finished processing BAM request
2018-11-25 22:15:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627426   8 58447 80154029 A  ERROR'
2018-11-25 22:15:54 [DEBUG   ] Got command BAM from MCS: ref #627427
2018-11-25 22:15:54 [INFO    ] Finished processing BAM request
2018-11-25 22:15:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627427   8 58447 80154033 A  ERROR'
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:15:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:15:54 [DEBUG   ] spawn_process: at 2018-11-25 22:15:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:15:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:16:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 22:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:16:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:16:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:16:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:16:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:16:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:16:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:16:04 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-11-25 22:16:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:16:25 [DEBUG   ] Got command BAM from MCS: ref #627428
2018-11-25 22:16:25 [INFO    ] Finished processing BAM request
2018-11-25 22:16:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627428   8 58447 80185033 A  ERROR'
2018-11-25 22:16:25 [DEBUG   ] Got command BAM from MCS: ref #627429
2018-11-25 22:16:25 [INFO    ] Finished processing BAM request
2018-11-25 22:16:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627429   8 58447 80185037 A  ERROR'
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:16:25 [DEBUG   ] spawn_process: at 2018-11-25 22:16:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:16:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:16:56 [DEBUG   ] Got command BAM from MCS: ref #627431
2018-11-25 22:16:56 [INFO    ] Finished processing BAM request
2018-11-25 22:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627431   8 58447 80216029 A  ERROR'
2018-11-25 22:16:56 [DEBUG   ] Got command BAM from MCS: ref #627430
2018-11-25 22:16:56 [INFO    ] Finished processing BAM request
2018-11-25 22:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627430   8 58447 80216033 A  ERROR'
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:16:56 [DEBUG   ] spawn_process: at 2018-11-25 22:16:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:16:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:17:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:17:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:17:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:17:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:17:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:17:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:17:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:17:04 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-11-25 22:17:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:17:26 [DEBUG   ] Got command RPT from MCS: ref #627434
2018-11-25 22:17:26 [DEBUG   ] summary = ERROR
2018-11-25 22:17:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627434  13 58447 80246961 A  ERRORERROR'
2018-11-25 22:17:27 [DEBUG   ] Got command BAM from MCS: ref #627433
2018-11-25 22:17:27 [INFO    ] Finished processing BAM request
2018-11-25 22:17:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627433   8 58447 80247025 A  ERROR'
2018-11-25 22:17:27 [DEBUG   ] Got command BAM from MCS: ref #627432
2018-11-25 22:17:27 [INFO    ] Finished processing BAM request
2018-11-25 22:17:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627432   8 58447 80247029 A  ERROR'
2018-11-25 22:17:27 [DEBUG   ] Got command RPT from MCS: ref #627435
2018-11-25 22:17:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627435  77 58447 80247161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:17:27 [DEBUG   ] Got command RPT from MCS: ref #627436
2018-11-25 22:17:27 [DEBUG   ] summary = ERROR
2018-11-25 22:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627436  13 58447 80247365 A  ERRORERROR'
2018-11-25 22:17:27 [DEBUG   ] Got command RPT from MCS: ref #627437
2018-11-25 22:17:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627437  77 58447 80247569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:17:27 [DEBUG   ] Got command RPT from MCS: ref #627438
2018-11-25 22:17:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627438  12 58447 80247761 A  ERRORB¢ff'
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:17:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:17:27 [DEBUG   ] spawn_process: at 2018-11-25 22:17:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:17:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:17:58 [DEBUG   ] Got command BAM from MCS: ref #627440
2018-11-25 22:17:58 [INFO    ] Finished processing BAM request
2018-11-25 22:17:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627440   8 58447 80278025 A  ERROR'
2018-11-25 22:17:58 [DEBUG   ] Got command BAM from MCS: ref #627439
2018-11-25 22:17:58 [INFO    ] Finished processing BAM request
2018-11-25 22:17:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627439   8 58447 80278029 A  ERROR'
2018-11-25 22:17:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:17:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:17:58 [DEBUG   ] spawn_process: at 2018-11-25 22:17:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 22:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 22:18:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:18:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:18:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:18:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:18:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:18:04 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-11-25 22:18:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:18:29 [DEBUG   ] Got command BAM from MCS: ref #627442
2018-11-25 22:18:29 [INFO    ] Finished processing BAM request
2018-11-25 22:18:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627442   8 58447 80309029 A  ERROR'
2018-11-25 22:18:29 [DEBUG   ] Got command BAM from MCS: ref #627441
2018-11-25 22:18:29 [INFO    ] Finished processing BAM request
2018-11-25 22:18:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627441   8 58447 80309033 A  ERROR'
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:18:29 [DEBUG   ] spawn_process: at 2018-11-25 22:18:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:18:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:18:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:19:00 [DEBUG   ] Got command BAM from MCS: ref #627448
2018-11-25 22:19:00 [INFO    ] Finished processing BAM request
2018-11-25 22:19:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627448   8 58447 80340025 A  ERROR'
2018-11-25 22:19:00 [DEBUG   ] Got command BAM from MCS: ref #627447
2018-11-25 22:19:00 [INFO    ] Finished processing BAM request
2018-11-25 22:19:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627447   8 58447 80340029 A  ERROR'
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:19:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:19:00 [DEBUG   ] spawn_process: at 2018-11-25 22:19:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:19:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:19:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:19:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:19:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:19:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:19:04 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-25 22:19:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:19:31 [DEBUG   ] Got command BAM from MCS: ref #627450
2018-11-25 22:19:31 [INFO    ] Finished processing BAM request
2018-11-25 22:19:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627450   8 58447 80371025 A  ERROR'
2018-11-25 22:19:31 [DEBUG   ] Got command BAM from MCS: ref #627449
2018-11-25 22:19:31 [INFO    ] Finished processing BAM request
2018-11-25 22:19:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627449   8 58447 80371029 A  ERROR'
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:19:31 [DEBUG   ] spawn_process: at 2018-11-25 22:19:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:19:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:19:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:20:02 [DEBUG   ] Got command BAM from MCS: ref #627452
2018-11-25 22:20:02 [INFO    ] Finished processing BAM request
2018-11-25 22:20:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627452   8 58447 80402033 A  ERROR'
2018-11-25 22:20:02 [DEBUG   ] Got command BAM from MCS: ref #627451
2018-11-25 22:20:02 [INFO    ] Finished processing BAM request
2018-11-25 22:20:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627451   8 58447 80402037 A  ERROR'
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:20:02 [DEBUG   ] spawn_process: at 2018-11-25 22:20:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 22:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 22:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-25 22:20:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:20:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:20:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:20:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:20:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:20:04 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-11-25 22:20:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 22:20:33 [DEBUG   ] Got command BAM from MCS: ref #627453
2018-11-25 22:20:33 [INFO    ] Finished processing BAM request
2018-11-25 22:20:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627453   8 58447 80433029 A  ERROR'
2018-11-25 22:20:33 [DEBUG   ] Got command BAM from MCS: ref #627454
2018-11-25 22:20:33 [INFO    ] Finished processing BAM request
2018-11-25 22:20:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:20:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627454   8 58447 80433033 A  ERROR'
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:20:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:20:33 [DEBUG   ] spawn_process: at 2018-11-25 22:20:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:20:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-25 22:20:48 [DEBUG   ] Got command RPT from MCS: ref #627455
2018-11-25 22:20:48 [DEBUG   ] summary = ERROR
2018-11-25 22:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627455  13 58447 80448525 A  ERRORERROR'
2018-11-25 22:20:48 [DEBUG   ] Got command RPT from MCS: ref #627456
2018-11-25 22:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627456  77 58447 80448526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:20:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 22:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 22:21:04 [DEBUG   ] Got command BAM from MCS: ref #627472
2018-11-25 22:21:04 [INFO    ] Finished processing BAM request
2018-11-25 22:21:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627472   8 58447 80464033 A  ERROR'
2018-11-25 22:21:04 [DEBUG   ] Got command BAM from MCS: ref #627473
2018-11-25 22:21:04 [INFO    ] Finished processing BAM request
2018-11-25 22:21:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:21:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627473   8 58447 80464037 A  ERROR'
2018-11-25 22:21:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:21:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:21:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:21:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:21:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:21:04 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:21:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:21:04 [DEBUG   ] spawn_process: at 2018-11-25 22:21:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:21:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:21:35 [DEBUG   ] Got command BAM from MCS: ref #627475
2018-11-25 22:21:35 [INFO    ] Finished processing BAM request
2018-11-25 22:21:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627475   8 58447 80495029 A  ERROR'
2018-11-25 22:21:35 [DEBUG   ] Got command BAM from MCS: ref #627474
2018-11-25 22:21:35 [INFO    ] Finished processing BAM request
2018-11-25 22:21:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627474   8 58447 80495033 A  ERROR'
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:21:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:21:35 [DEBUG   ] spawn_process: at 2018-11-25 22:21:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:21:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:21:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:22:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:22:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:22:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:22:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:22:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:22:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:22:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:22:04 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-25 22:22:06 [DEBUG   ] Got command BAM from MCS: ref #627480
2018-11-25 22:22:06 [INFO    ] Finished processing BAM request
2018-11-25 22:22:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:22:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627480   8 58447 80526033 A  ERROR'
2018-11-25 22:22:06 [DEBUG   ] Got command BAM from MCS: ref #627481
2018-11-25 22:22:06 [INFO    ] Finished processing BAM request
2018-11-25 22:22:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:22:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627481   8 58447 80526037 A  ERROR'
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:22:06 [DEBUG   ] spawn_process: at 2018-11-25 22:22:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:22:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 22:22:27 [DEBUG   ] Got command RPT from MCS: ref #627484
2018-11-25 22:22:27 [DEBUG   ] summary = ERROR
2018-11-25 22:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627484  13 58447 80547049 A  ERRORERROR'
2018-11-25 22:22:27 [DEBUG   ] Got command RPT from MCS: ref #627485
2018-11-25 22:22:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627485  77 58447 80547253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:22:27 [DEBUG   ] Got command RPT from MCS: ref #627486
2018-11-25 22:22:27 [DEBUG   ] summary = ERROR
2018-11-25 22:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627486  13 58447 80547457 A  ERRORERROR'
2018-11-25 22:22:27 [DEBUG   ] Got command RPT from MCS: ref #627488
2018-11-25 22:22:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627488  77 58447 80547649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:22:27 [DEBUG   ] Got command RPT from MCS: ref #627490
2018-11-25 22:22:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627490  12 58447 80547853 A  ERRORB¡ff'
2018-11-25 22:22:37 [DEBUG   ] Got command BAM from MCS: ref #627494
2018-11-25 22:22:37 [INFO    ] Finished processing BAM request
2018-11-25 22:22:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627494   8 58447 80557025 A  ERROR'
2018-11-25 22:22:37 [DEBUG   ] Got command BAM from MCS: ref #627495
2018-11-25 22:22:37 [INFO    ] Finished processing BAM request
2018-11-25 22:22:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627495   8 58447 80557029 A  ERROR'
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:22:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:22:37 [DEBUG   ] spawn_process: at 2018-11-25 22:22:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:22:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:22:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:23:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:23:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:23:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:23:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:23:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:23:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:23:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:23:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:23:05 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-11-25 22:23:08 [DEBUG   ] Got command BAM from MCS: ref #627496
2018-11-25 22:23:08 [INFO    ] Finished processing BAM request
2018-11-25 22:23:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627496   8 58447 80588025 A  ERROR'
2018-11-25 22:23:08 [DEBUG   ] Got command BAM from MCS: ref #627497
2018-11-25 22:23:08 [INFO    ] Finished processing BAM request
2018-11-25 22:23:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627497   8 58447 80588029 A  ERROR'
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:23:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:23:08 [DEBUG   ] spawn_process: at 2018-11-25 22:23:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:23:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:23:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:23:39 [DEBUG   ] Got command BAM from MCS: ref #627499
2018-11-25 22:23:39 [INFO    ] Finished processing BAM request
2018-11-25 22:23:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627499   8 58447 80619029 A  ERROR'
2018-11-25 22:23:39 [DEBUG   ] Got command BAM from MCS: ref #627498
2018-11-25 22:23:39 [INFO    ] Finished processing BAM request
2018-11-25 22:23:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627498   8 58447 80619033 A  ERROR'
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:23:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:23:39 [DEBUG   ] spawn_process: at 2018-11-25 22:23:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:23:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:24:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:24:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 22:24:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:24:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:24:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:24:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:24:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:24:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:24:05 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-25 22:24:10 [DEBUG   ] Got command BAM from MCS: ref #627501
2018-11-25 22:24:10 [INFO    ] Finished processing BAM request
2018-11-25 22:24:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627501   8 58447 80650033 A  ERROR'
2018-11-25 22:24:10 [DEBUG   ] Got command BAM from MCS: ref #627500
2018-11-25 22:24:10 [INFO    ] Finished processing BAM request
2018-11-25 22:24:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627500   8 58447 80650037 A  ERROR'
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:24:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:24:10 [DEBUG   ] spawn_process: at 2018-11-25 22:24:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:24:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 22:24:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:24:41 [DEBUG   ] Got command BAM from MCS: ref #627506
2018-11-25 22:24:41 [INFO    ] Finished processing BAM request
2018-11-25 22:24:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627506   8 58447 80681029 A  ERROR'
2018-11-25 22:24:41 [DEBUG   ] Got command BAM from MCS: ref #627507
2018-11-25 22:24:41 [INFO    ] Finished processing BAM request
2018-11-25 22:24:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627507   8 58447 80681033 A  ERROR'
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:24:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:24:41 [DEBUG   ] spawn_process: at 2018-11-25 22:24:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:24:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 22:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 22:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:25:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:25:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:25:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:25:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:25:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:25:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:25:04 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-11-25 22:25:12 [DEBUG   ] Got command BAM from MCS: ref #627509
2018-11-25 22:25:12 [INFO    ] Finished processing BAM request
2018-11-25 22:25:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627509   8 58447 80712026 A  ERROR'
2018-11-25 22:25:12 [DEBUG   ] Got command BAM from MCS: ref #627508
2018-11-25 22:25:12 [INFO    ] Finished processing BAM request
2018-11-25 22:25:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627508   8 58447 80712030 A  ERROR'
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:25:12 [DEBUG   ] spawn_process: at 2018-11-25 22:25:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:25:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:25:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:25:43 [DEBUG   ] Got command BAM from MCS: ref #627510
2018-11-25 22:25:43 [INFO    ] Finished processing BAM request
2018-11-25 22:25:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:25:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627510   8 58447 80743030 A  ERROR'
2018-11-25 22:25:43 [DEBUG   ] Got command BAM from MCS: ref #627511
2018-11-25 22:25:43 [INFO    ] Finished processing BAM request
2018-11-25 22:25:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:25:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627511   8 58447 80743034 A  ERROR'
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:25:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:25:43 [DEBUG   ] spawn_process: at 2018-11-25 22:25:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:25:48 [DEBUG   ] Got command RPT from MCS: ref #627512
2018-11-25 22:25:48 [DEBUG   ] summary = ERROR
2018-11-25 22:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627512  13 58447 80748518 A  ERRORERROR'
2018-11-25 22:25:48 [DEBUG   ] Got command RPT from MCS: ref #627513
2018-11-25 22:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627513  77 58447 80748518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:25:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:26:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:26:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:26:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:26:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:26:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:26:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:26:04 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-11-25 22:26:14 [DEBUG   ] Got command BAM from MCS: ref #627530
2018-11-25 22:26:14 [INFO    ] Finished processing BAM request
2018-11-25 22:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627530   8 58447 80774034 A  ERROR'
2018-11-25 22:26:14 [DEBUG   ] Got command BAM from MCS: ref #627529
2018-11-25 22:26:14 [INFO    ] Finished processing BAM request
2018-11-25 22:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627529   8 58447 80774038 A  ERROR'
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:26:14 [DEBUG   ] spawn_process: at 2018-11-25 22:26:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:26:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 22:26:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:26:45 [DEBUG   ] Got command BAM from MCS: ref #627531
2018-11-25 22:26:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627531   8 58447 80805030 A  ERROR'
2018-11-25 22:26:45 [DEBUG   ] Got command BAM from MCS: ref #627532
2018-11-25 22:26:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627532   8 58447 80805034 A  ERROR'
2018-11-25 22:26:45 [INFO    ] Finished processing BAM request
2018-11-25 22:26:45 [INFO    ] Finished processing BAM request
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:26:45 [DEBUG   ] spawn_process: at 2018-11-25 22:26:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:26:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:27:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:27:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:27:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:27:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:27:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:27:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:27:04 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-25 22:27:16 [DEBUG   ] Got command BAM from MCS: ref #627533
2018-11-25 22:27:16 [INFO    ] Finished processing BAM request
2018-11-25 22:27:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627533   8 58447 80836034 A  ERROR'
2018-11-25 22:27:16 [DEBUG   ] Got command BAM from MCS: ref #627534
2018-11-25 22:27:16 [INFO    ] Finished processing BAM request
2018-11-25 22:27:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627534   8 58447 80836038 A  ERROR'
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:27:16 [DEBUG   ] spawn_process: at 2018-11-25 22:27:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:27:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 22:27:27 [DEBUG   ] Got command RPT from MCS: ref #627535
2018-11-25 22:27:27 [DEBUG   ] summary = ERROR
2018-11-25 22:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627535  13 58447 80847141 A  ERRORERROR'
2018-11-25 22:27:27 [DEBUG   ] Got command RPT from MCS: ref #627536
2018-11-25 22:27:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627536  77 58447 80847333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:27:27 [DEBUG   ] Got command RPT from MCS: ref #627537
2018-11-25 22:27:27 [DEBUG   ] summary = ERROR
2018-11-25 22:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627537  13 58447 80847537 A  ERRORERROR'
2018-11-25 22:27:27 [DEBUG   ] Got command RPT from MCS: ref #627538
2018-11-25 22:27:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627538  77 58447 80847741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:27:27 [DEBUG   ] Got command RPT from MCS: ref #627539
2018-11-25 22:27:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627539  12 58447 80847945 A  ERRORB¢ff'
2018-11-25 22:27:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:27:47 [DEBUG   ] Got command BAM from MCS: ref #627544
2018-11-25 22:27:47 [INFO    ] Finished processing BAM request
2018-11-25 22:27:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:27:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627544   8 58447 80867029 A  ERROR'
2018-11-25 22:27:47 [DEBUG   ] Got command BAM from MCS: ref #627545
2018-11-25 22:27:47 [INFO    ] Finished processing BAM request
2018-11-25 22:27:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:27:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627545   8 58447 80867033 A  ERROR'
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:27:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:27:47 [DEBUG   ] spawn_process: at 2018-11-25 22:27:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:27:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:28:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-11-25 22:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:28:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:28:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:28:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:28:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:28:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:28:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:28:04 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-11-25 22:28:18 [DEBUG   ] Got command BAM from MCS: ref #627546
2018-11-25 22:28:18 [INFO    ] Finished processing BAM request
2018-11-25 22:28:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627546   8 58447 80898033 A  ERROR'
2018-11-25 22:28:18 [DEBUG   ] Got command BAM from MCS: ref #627547
2018-11-25 22:28:18 [INFO    ] Finished processing BAM request
2018-11-25 22:28:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627547   8 58447 80898037 A  ERROR'
2018-11-25 22:28:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:28:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:28:18 [DEBUG   ] spawn_process: at 2018-11-25 22:28:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:28:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:28:49 [DEBUG   ] Got command BAM from MCS: ref #627549
2018-11-25 22:28:49 [INFO    ] Finished processing BAM request
2018-11-25 22:28:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627549   8 58447 80929025 A  ERROR'
2018-11-25 22:28:49 [DEBUG   ] Got command BAM from MCS: ref #627548
2018-11-25 22:28:49 [INFO    ] Finished processing BAM request
2018-11-25 22:28:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627548   8 58447 80929029 A  ERROR'
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:28:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:28:49 [DEBUG   ] spawn_process: at 2018-11-25 22:28:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:28:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:29:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 22:29:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:29:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:29:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:29:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:29:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:29:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:29:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:29:04 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-25 22:29:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:29:20 [DEBUG   ] Got command BAM from MCS: ref #627551
2018-11-25 22:29:20 [INFO    ] Finished processing BAM request
2018-11-25 22:29:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627551   8 58447 80960033 A  ERROR'
2018-11-25 22:29:20 [DEBUG   ] Got command BAM from MCS: ref #627550
2018-11-25 22:29:20 [INFO    ] Finished processing BAM request
2018-11-25 22:29:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627550   8 58447 80960037 A  ERROR'
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:29:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:29:20 [DEBUG   ] spawn_process: at 2018-11-25 22:29:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:29:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:29:51 [DEBUG   ] Got command BAM from MCS: ref #627553
2018-11-25 22:29:51 [INFO    ] Finished processing BAM request
2018-11-25 22:29:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627553   8 58447 80991029 A  ERROR'
2018-11-25 22:29:51 [DEBUG   ] Got command BAM from MCS: ref #627552
2018-11-25 22:29:51 [INFO    ] Finished processing BAM request
2018-11-25 22:29:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627552   8 58447 80991033 A  ERROR'
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:29:51 [DEBUG   ] spawn_process: at 2018-11-25 22:29:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:29:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 22:30:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:30:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:30:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:30:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:30:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:30:04 [WARNING ] (13, 1, 'bot')
2018-11-25 22:30:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:30:04 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-11-25 22:30:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:30:22 [DEBUG   ] Got command BAM from MCS: ref #627554
2018-11-25 22:30:22 [INFO    ] Finished processing BAM request
2018-11-25 22:30:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627554   8 58447 81022025 A  ERROR'
2018-11-25 22:30:22 [DEBUG   ] Got command BAM from MCS: ref #627555
2018-11-25 22:30:22 [INFO    ] Finished processing BAM request
2018-11-25 22:30:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627555   8 58447 81022029 A  ERROR'
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:30:22 [DEBUG   ] spawn_process: at 2018-11-25 22:30:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:30:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:30:48 [DEBUG   ] Got command RPT from MCS: ref #627560
2018-11-25 22:30:48 [DEBUG   ] summary = ERROR
2018-11-25 22:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627560  13 58447 81048517 A  ERRORERROR'
2018-11-25 22:30:48 [DEBUG   ] Got command RPT from MCS: ref #627561
2018-11-25 22:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627561  77 58447 81048518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:30:53 [DEBUG   ] Got command BAM from MCS: ref #627578
2018-11-25 22:30:53 [INFO    ] Finished processing BAM request
2018-11-25 22:30:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:30:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627578   8 58447 81053033 A  ERROR'
2018-11-25 22:30:53 [DEBUG   ] Got command BAM from MCS: ref #627577
2018-11-25 22:30:53 [INFO    ] Finished processing BAM request
2018-11-25 22:30:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:30:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627577   8 58447 81053037 A  ERROR'
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:30:53 [DEBUG   ] spawn_process: at 2018-11-25 22:30:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:30:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:31:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:31:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 22:31:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:31:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:31:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:31:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:31:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:31:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:31:05 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-11-25 22:31:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:31:24 [DEBUG   ] Got command BAM from MCS: ref #627580
2018-11-25 22:31:24 [INFO    ] Finished processing BAM request
2018-11-25 22:31:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627580   8 58447 81084025 A  ERROR'
2018-11-25 22:31:24 [DEBUG   ] Got command BAM from MCS: ref #627579
2018-11-25 22:31:24 [INFO    ] Finished processing BAM request
2018-11-25 22:31:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:31:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627579   8 58447 81084029 A  ERROR'
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:31:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:31:24 [DEBUG   ] spawn_process: at 2018-11-25 22:31:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:31:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:31:55 [DEBUG   ] Got command BAM from MCS: ref #627582
2018-11-25 22:31:55 [INFO    ] Finished processing BAM request
2018-11-25 22:31:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627582   8 58447 81115029 A  ERROR'
2018-11-25 22:31:55 [DEBUG   ] Got command BAM from MCS: ref #627581
2018-11-25 22:31:55 [INFO    ] Finished processing BAM request
2018-11-25 22:31:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627581   8 58447 81115033 A  ERROR'
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:31:55 [DEBUG   ] spawn_process: at 2018-11-25 22:31:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:31:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 22:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:32:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 22:32:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:32:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:32:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:32:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:32:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:32:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:32:05 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-25 22:32:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 22:32:26 [DEBUG   ] Got command BAM from MCS: ref #627586
2018-11-25 22:32:26 [INFO    ] Finished processing BAM request
2018-11-25 22:32:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627586   8 58447 81146025 A  ERROR'
2018-11-25 22:32:26 [DEBUG   ] Got command BAM from MCS: ref #627585
2018-11-25 22:32:26 [INFO    ] Finished processing BAM request
2018-11-25 22:32:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627585   8 58447 81146029 A  ERROR'
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:32:26 [DEBUG   ] spawn_process: at 2018-11-25 22:32:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:32:27 [DEBUG   ] Got command RPT from MCS: ref #627587
2018-11-25 22:32:27 [DEBUG   ] summary = ERROR
2018-11-25 22:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627587  13 58447 81147221 A  ERRORERROR'
2018-11-25 22:32:27 [DEBUG   ] Got command RPT from MCS: ref #627588
2018-11-25 22:32:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627588  77 58447 81147425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:32:27 [DEBUG   ] Got command RPT from MCS: ref #627589
2018-11-25 22:32:27 [DEBUG   ] summary = ERROR
2018-11-25 22:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627589  13 58447 81147617 A  ERRORERROR'
2018-11-25 22:32:27 [DEBUG   ] Got command RPT from MCS: ref #627591
2018-11-25 22:32:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627591  77 58447 81147821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:32:28 [DEBUG   ] Got command RPT from MCS: ref #627593
2018-11-25 22:32:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627593  12 58447 81148025 A  ERRORB¤ff'
2018-11-25 22:32:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:32:57 [DEBUG   ] Got command BAM from MCS: ref #627598
2018-11-25 22:32:57 [INFO    ] Finished processing BAM request
2018-11-25 22:32:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:32:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627598   8 58447 81177029 A  ERROR'
2018-11-25 22:32:57 [DEBUG   ] Got command BAM from MCS: ref #627597
2018-11-25 22:32:57 [INFO    ] Finished processing BAM request
2018-11-25 22:32:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:32:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627597   8 58447 81177033 A  ERROR'
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:32:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:32:57 [DEBUG   ] spawn_process: at 2018-11-25 22:32:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:32:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-25 22:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:33:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:33:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:33:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:33:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:33:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:33:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:33:05 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-11-25 22:33:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:33:28 [DEBUG   ] Got command BAM from MCS: ref #627600
2018-11-25 22:33:28 [INFO    ] Finished processing BAM request
2018-11-25 22:33:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627600   8 58447 81208033 A  ERROR'
2018-11-25 22:33:28 [DEBUG   ] Got command BAM from MCS: ref #627599
2018-11-25 22:33:28 [INFO    ] Finished processing BAM request
2018-11-25 22:33:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627599   8 58447 81208037 A  ERROR'
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:33:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:33:28 [DEBUG   ] spawn_process: at 2018-11-25 22:33:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:33:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 22:33:59 [DEBUG   ] Got command BAM from MCS: ref #627606
2018-11-25 22:33:59 [INFO    ] Finished processing BAM request
2018-11-25 22:33:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627606   8 58447 81239033 A  ERROR'
2018-11-25 22:33:59 [DEBUG   ] Got command BAM from MCS: ref #627605
2018-11-25 22:33:59 [INFO    ] Finished processing BAM request
2018-11-25 22:33:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627605   8 58447 81239037 A  ERROR'
2018-11-25 22:33:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:33:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:33:59 [DEBUG   ] spawn_process: at 2018-11-25 22:33:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 22:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:34:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:34:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:34:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:34:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:34:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:34:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:34:05 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-25 22:34:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:34:30 [DEBUG   ] Got command BAM from MCS: ref #627608
2018-11-25 22:34:30 [INFO    ] Finished processing BAM request
2018-11-25 22:34:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627608   8 58447 81270033 A  ERROR'
2018-11-25 22:34:30 [DEBUG   ] Got command BAM from MCS: ref #627607
2018-11-25 22:34:30 [INFO    ] Finished processing BAM request
2018-11-25 22:34:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627607   8 58447 81270037 A  ERROR'
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:34:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:34:30 [DEBUG   ] spawn_process: at 2018-11-25 22:34:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:34:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:34:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:35:01 [DEBUG   ] Got command BAM from MCS: ref #627610
2018-11-25 22:35:01 [INFO    ] Finished processing BAM request
2018-11-25 22:35:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627610   8 58447 81301029 A  ERROR'
2018-11-25 22:35:01 [DEBUG   ] Got command BAM from MCS: ref #627609
2018-11-25 22:35:01 [INFO    ] Finished processing BAM request
2018-11-25 22:35:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627609   8 58447 81301033 A  ERROR'
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:35:01 [DEBUG   ] spawn_process: at 2018-11-25 22:35:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:35:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-25 22:35:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:35:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:35:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:35:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:35:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:35:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:35:05 [DEBUG   ] Finished updating board flags in 1.044 seconds
2018-11-25 22:35:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:35:32 [DEBUG   ] Got command BAM from MCS: ref #627612
2018-11-25 22:35:32 [INFO    ] Finished processing BAM request
2018-11-25 22:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627612   8 58447 81332033 A  ERROR'
2018-11-25 22:35:32 [DEBUG   ] Got command BAM from MCS: ref #627611
2018-11-25 22:35:32 [INFO    ] Finished processing BAM request
2018-11-25 22:35:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:35:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627611   8 58447 81332037 A  ERROR'
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:35:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:35:32 [DEBUG   ] spawn_process: at 2018-11-25 22:35:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:35:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 22:35:48 [DEBUG   ] Got command RPT from MCS: ref #627613
2018-11-25 22:35:48 [DEBUG   ] summary = ERROR
2018-11-25 22:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627613  13 58447 81348521 A  ERRORERROR'
2018-11-25 22:35:48 [DEBUG   ] Got command RPT from MCS: ref #627614
2018-11-25 22:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627614  77 58447 81348522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:35:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:36:03 [DEBUG   ] Got command BAM from MCS: ref #627631
2018-11-25 22:36:03 [INFO    ] Finished processing BAM request
2018-11-25 22:36:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627631   8 58447 81363025 A  ERROR'
2018-11-25 22:36:03 [DEBUG   ] Got command BAM from MCS: ref #627630
2018-11-25 22:36:03 [INFO    ] Finished processing BAM request
2018-11-25 22:36:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:36:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627630   8 58447 81363029 A  ERROR'
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:36:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:36:03 [DEBUG   ] spawn_process: at 2018-11-25 22:36:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 22:36:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:36:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:36:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:36:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:36:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:36:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:36:05 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-25 22:36:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 22:36:34 [DEBUG   ] Got command BAM from MCS: ref #627633
2018-11-25 22:36:34 [INFO    ] Finished processing BAM request
2018-11-25 22:36:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627633   8 58447 81394049 A  ERROR'
2018-11-25 22:36:34 [DEBUG   ] Got command BAM from MCS: ref #627632
2018-11-25 22:36:34 [INFO    ] Finished processing BAM request
2018-11-25 22:36:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627632   8 58447 81394053 A  ERROR'
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:36:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:36:34 [DEBUG   ] spawn_process: at 2018-11-25 22:36:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:36:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 22:36:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:37:05 [DEBUG   ] Got command BAM from MCS: ref #627638
2018-11-25 22:37:05 [INFO    ] Finished processing BAM request
2018-11-25 22:37:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627638   8 58447 81425041 A  ERROR'
2018-11-25 22:37:05 [DEBUG   ] Got command BAM from MCS: ref #627639
2018-11-25 22:37:05 [INFO    ] Finished processing BAM request
2018-11-25 22:37:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627639   8 58447 81425049 A  ERROR'
2018-11-25 22:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-11-25 22:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:37:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 22:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:37:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:37:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:37:05 [DEBUG   ] spawn_process: at 2018-11-25 22:37:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:37:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:37:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:37:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:37:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:37:05 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-11-25 22:37:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:37:27 [DEBUG   ] Got command RPT from MCS: ref #627640
2018-11-25 22:37:27 [DEBUG   ] summary = ERROR
2018-11-25 22:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627640  13 58447 81447313 A  ERRORERROR'
2018-11-25 22:37:27 [DEBUG   ] Got command RPT from MCS: ref #627641
2018-11-25 22:37:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627641  77 58447 81447505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:37:27 [DEBUG   ] Got command RPT from MCS: ref #627642
2018-11-25 22:37:27 [DEBUG   ] summary = ERROR
2018-11-25 22:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627642  13 58447 81447709 A  ERRORERROR'
2018-11-25 22:37:27 [DEBUG   ] Got command RPT from MCS: ref #627643
2018-11-25 22:37:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627643  77 58447 81447913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:37:28 [DEBUG   ] Got command RPT from MCS: ref #627644
2018-11-25 22:37:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627644  12 58447 81448117 A  ERRORB£ff'
2018-11-25 22:37:36 [DEBUG   ] Got command BAM from MCS: ref #627646
2018-11-25 22:37:36 [INFO    ] Finished processing BAM request
2018-11-25 22:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627646   8 58447 81456029 A  ERROR'
2018-11-25 22:37:36 [DEBUG   ] Got command BAM from MCS: ref #627645
2018-11-25 22:37:36 [INFO    ] Finished processing BAM request
2018-11-25 22:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627645   8 58447 81456033 A  ERROR'
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:37:36 [DEBUG   ] spawn_process: at 2018-11-25 22:37:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:37:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:37:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:38:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:38:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:38:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:38:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:38:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:38:05 [DEBUG   ] Finished updating board flags in 1.291 seconds
2018-11-25 22:38:08 [DEBUG   ] Got command BAM from MCS: ref #627647
2018-11-25 22:38:08 [INFO    ] Finished processing BAM request
2018-11-25 22:38:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627647   8 58447 81488033 A  ERROR'
2018-11-25 22:38:08 [DEBUG   ] Got command BAM from MCS: ref #627648
2018-11-25 22:38:08 [INFO    ] Finished processing BAM request
2018-11-25 22:38:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627648   8 58447 81488037 A  ERROR'
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:38:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:38:08 [DEBUG   ] spawn_process: at 2018-11-25 22:38:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:38:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:38:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:38:40 [DEBUG   ] Got command BAM from MCS: ref #627649
2018-11-25 22:38:40 [INFO    ] Finished processing BAM request
2018-11-25 22:38:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627649   8 58447 81520029 A  ERROR'
2018-11-25 22:38:40 [DEBUG   ] Got command BAM from MCS: ref #627650
2018-11-25 22:38:40 [INFO    ] Finished processing BAM request
2018-11-25 22:38:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627650   8 58447 81520033 A  ERROR'
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:38:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:38:40 [DEBUG   ] spawn_process: at 2018-11-25 22:38:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:38:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 22:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-25 22:39:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:39:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-25 22:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:39:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:39:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:39:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:39:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:39:05 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-11-25 22:39:12 [DEBUG   ] Got command BAM from MCS: ref #627651
2018-11-25 22:39:12 [INFO    ] Finished processing BAM request
2018-11-25 22:39:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627651   8 58447 81552033 A  ERROR'
2018-11-25 22:39:12 [DEBUG   ] Got command BAM from MCS: ref #627652
2018-11-25 22:39:12 [INFO    ] Finished processing BAM request
2018-11-25 22:39:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627652   8 58447 81552037 A  ERROR'
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:39:12 [DEBUG   ] spawn_process: at 2018-11-25 22:39:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:39:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:39:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:39:44 [DEBUG   ] Got command BAM from MCS: ref #627657
2018-11-25 22:39:44 [INFO    ] Finished processing BAM request
2018-11-25 22:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627657   8 58447 81584033 A  ERROR'
2018-11-25 22:39:44 [DEBUG   ] Got command BAM from MCS: ref #627658
2018-11-25 22:39:44 [INFO    ] Finished processing BAM request
2018-11-25 22:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627658   8 58447 81584037 A  ERROR'
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:39:44 [DEBUG   ] spawn_process: at 2018-11-25 22:39:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:39:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-25 22:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:40:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:40:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:40:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:40:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:40:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:40:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:40:05 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-25 22:40:16 [DEBUG   ] Got command BAM from MCS: ref #627660
2018-11-25 22:40:16 [INFO    ] Finished processing BAM request
2018-11-25 22:40:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627660   8 58447 81616025 A  ERROR'
2018-11-25 22:40:16 [DEBUG   ] Got command BAM from MCS: ref #627659
2018-11-25 22:40:16 [INFO    ] Finished processing BAM request
2018-11-25 22:40:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627659   8 58447 81616029 A  ERROR'
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:40:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:40:16 [DEBUG   ] spawn_process: at 2018-11-25 22:40:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:40:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 22:40:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:40:48 [DEBUG   ] Got command BAM from MCS: ref #627662
2018-11-25 22:40:48 [INFO    ] Finished processing BAM request
2018-11-25 22:40:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627662   8 58447 81648029 A  ERROR'
2018-11-25 22:40:48 [DEBUG   ] Got command BAM from MCS: ref #627661
2018-11-25 22:40:48 [INFO    ] Finished processing BAM request
2018-11-25 22:40:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627661   8 58447 81648033 A  ERROR'
2018-11-25 22:40:48 [DEBUG   ] Got command RPT from MCS: ref #627663
2018-11-25 22:40:48 [DEBUG   ] summary = ERROR
2018-11-25 22:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627663  13 58447 81648525 A  ERRORERROR'
2018-11-25 22:40:48 [DEBUG   ] Got command RPT from MCS: ref #627664
2018-11-25 22:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627664  77 58447 81648526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:40:48 [DEBUG   ] spawn_process: at 2018-11-25 22:40:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:40:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 22:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 22:41:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:41:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:41:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:41:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:41:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:41:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:41:05 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-11-25 22:41:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:41:20 [DEBUG   ] Got command BAM from MCS: ref #627681
2018-11-25 22:41:20 [INFO    ] Finished processing BAM request
2018-11-25 22:41:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627681   8 58447 81680025 A  ERROR'
2018-11-25 22:41:20 [DEBUG   ] Got command BAM from MCS: ref #627680
2018-11-25 22:41:20 [INFO    ] Finished processing BAM request
2018-11-25 22:41:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:41:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627680   8 58447 81680029 A  ERROR'
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:41:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:41:20 [DEBUG   ] spawn_process: at 2018-11-25 22:41:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:41:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:41:52 [DEBUG   ] Got command BAM from MCS: ref #627682
2018-11-25 22:41:52 [INFO    ] Finished processing BAM request
2018-11-25 22:41:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627682   8 58447 81712033 A  ERROR'
2018-11-25 22:41:52 [DEBUG   ] Got command BAM from MCS: ref #627683
2018-11-25 22:41:52 [INFO    ] Finished processing BAM request
2018-11-25 22:41:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627683   8 58447 81712037 A  ERROR'
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:41:52 [DEBUG   ] spawn_process: at 2018-11-25 22:41:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:41:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:42:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 22:42:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:42:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:42:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:42:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:42:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:42:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:42:05 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-25 22:42:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:42:24 [DEBUG   ] Got command BAM from MCS: ref #627687
2018-11-25 22:42:24 [INFO    ] Finished processing BAM request
2018-11-25 22:42:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627687   8 58447 81744029 A  ERROR'
2018-11-25 22:42:24 [DEBUG   ] Got command BAM from MCS: ref #627686
2018-11-25 22:42:24 [INFO    ] Finished processing BAM request
2018-11-25 22:42:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:42:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627686   8 58447 81744033 A  ERROR'
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:42:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:42:24 [DEBUG   ] spawn_process: at 2018-11-25 22:42:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:42:27 [DEBUG   ] Got command RPT from MCS: ref #627688
2018-11-25 22:42:27 [DEBUG   ] summary = ERROR
2018-11-25 22:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627688  13 58447 81747393 A  ERRORERROR'
2018-11-25 22:42:27 [DEBUG   ] Got command RPT from MCS: ref #627689
2018-11-25 22:42:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627689  77 58447 81747597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:42:27 [DEBUG   ] Got command RPT from MCS: ref #627690
2018-11-25 22:42:27 [DEBUG   ] summary = ERROR
2018-11-25 22:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627690  13 58447 81747801 A  ERRORERROR'
2018-11-25 22:42:27 [DEBUG   ] Got command RPT from MCS: ref #627692
2018-11-25 22:42:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627692  77 58447 81747993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:42:28 [DEBUG   ] Got command RPT from MCS: ref #627694
2018-11-25 22:42:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627694  12 58447 81748197 A  ERRORB£ff'
2018-11-25 22:42:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:42:56 [DEBUG   ] Got command BAM from MCS: ref #627702
2018-11-25 22:42:56 [INFO    ] Finished processing BAM request
2018-11-25 22:42:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:42:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627702   8 58447 81776029 A  ERROR'
2018-11-25 22:42:56 [DEBUG   ] Got command BAM from MCS: ref #627703
2018-11-25 22:42:56 [INFO    ] Finished processing BAM request
2018-11-25 22:42:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:42:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627703   8 58447 81776033 A  ERROR'
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:42:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:42:56 [DEBUG   ] spawn_process: at 2018-11-25 22:42:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:42:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:43:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:43:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:43:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:43:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:43:05 [WARNING ] (13, 1, 'bot')
2018-11-25 22:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:43:05 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-11-25 22:43:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:43:28 [DEBUG   ] Got command BAM from MCS: ref #627705
2018-11-25 22:43:28 [INFO    ] Finished processing BAM request
2018-11-25 22:43:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627705   8 58447 81808033 A  ERROR'
2018-11-25 22:43:28 [DEBUG   ] Got command BAM from MCS: ref #627704
2018-11-25 22:43:28 [INFO    ] Finished processing BAM request
2018-11-25 22:43:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627704   8 58447 81808037 A  ERROR'
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:43:28 [DEBUG   ] spawn_process: at 2018-11-25 22:43:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:43:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:43:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:44:00 [DEBUG   ] Got command BAM from MCS: ref #627707
2018-11-25 22:44:00 [INFO    ] Finished processing BAM request
2018-11-25 22:44:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627707   8 58447 81840025 A  ERROR'
2018-11-25 22:44:00 [DEBUG   ] Got command BAM from MCS: ref #627706
2018-11-25 22:44:00 [INFO    ] Finished processing BAM request
2018-11-25 22:44:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627706   8 58447 81840029 A  ERROR'
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:44:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:44:00 [DEBUG   ] spawn_process: at 2018-11-25 22:44:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 22:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:44:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:44:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:44:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:44:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:44:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:44:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:44:06 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-11-25 22:44:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:44:32 [DEBUG   ] Got command BAM from MCS: ref #627709
2018-11-25 22:44:32 [INFO    ] Finished processing BAM request
2018-11-25 22:44:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627709   8 58447 81872025 A  ERROR'
2018-11-25 22:44:32 [DEBUG   ] Got command BAM from MCS: ref #627708
2018-11-25 22:44:32 [INFO    ] Finished processing BAM request
2018-11-25 22:44:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627708   8 58447 81872029 A  ERROR'
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:44:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:44:32 [DEBUG   ] spawn_process: at 2018-11-25 22:44:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:44:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:44:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:45:04 [DEBUG   ] Got command BAM from MCS: ref #627710
2018-11-25 22:45:04 [INFO    ] Finished processing BAM request
2018-11-25 22:45:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627710   8 58447 81904033 A  ERROR'
2018-11-25 22:45:04 [DEBUG   ] Got command BAM from MCS: ref #627711
2018-11-25 22:45:04 [INFO    ] Finished processing BAM request
2018-11-25 22:45:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627711   8 58447 81904037 A  ERROR'
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:45:04 [DEBUG   ] spawn_process: at 2018-11-25 22:45:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:45:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-25 22:45:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:45:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:45:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:45:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:45:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:45:06 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-25 22:45:19 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-11-25 22:45:36 [DEBUG   ] Got command BAM from MCS: ref #627713
2018-11-25 22:45:36 [INFO    ] Finished processing BAM request
2018-11-25 22:45:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627713   8 58447 81936029 A  ERROR'
2018-11-25 22:45:36 [DEBUG   ] Got command BAM from MCS: ref #627712
2018-11-25 22:45:36 [INFO    ] Finished processing BAM request
2018-11-25 22:45:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:45:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627712   8 58447 81936033 A  ERROR'
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:45:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:45:36 [DEBUG   ] spawn_process: at 2018-11-25 22:45:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:45:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:45:48 [DEBUG   ] Got command RPT from MCS: ref #627718
2018-11-25 22:45:48 [DEBUG   ] summary = ERROR
2018-11-25 22:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627718  13 58447 81948525 A  ERRORERROR'
2018-11-25 22:45:48 [DEBUG   ] Got command RPT from MCS: ref #627719
2018-11-25 22:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627719  77 58447 81948526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:46:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:46:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:46:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:46:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:46:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:46:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:46:06 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-25 22:46:08 [DEBUG   ] Got command BAM from MCS: ref #627736
2018-11-25 22:46:08 [INFO    ] Finished processing BAM request
2018-11-25 22:46:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627736   8 58447 81968029 A  ERROR'
2018-11-25 22:46:08 [DEBUG   ] Got command BAM from MCS: ref #627735
2018-11-25 22:46:08 [INFO    ] Finished processing BAM request
2018-11-25 22:46:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:46:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627735   8 58447 81968033 A  ERROR'
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:46:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:46:08 [DEBUG   ] spawn_process: at 2018-11-25 22:46:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:46:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:46:40 [DEBUG   ] Got command BAM from MCS: ref #627738
2018-11-25 22:46:40 [INFO    ] Finished processing BAM request
2018-11-25 22:46:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627738   8 58447 82000033 A  ERROR'
2018-11-25 22:46:40 [DEBUG   ] Got command BAM from MCS: ref #627737
2018-11-25 22:46:40 [INFO    ] Finished processing BAM request
2018-11-25 22:46:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627737   8 58447 82000037 A  ERROR'
2018-11-25 22:46:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:46:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:46:40 [DEBUG   ] spawn_process: at 2018-11-25 22:46:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:47:00 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 22:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:47:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2018-11-25 22:47:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:47:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:47:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:47:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:47:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:47:06 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-11-25 22:47:12 [DEBUG   ] Got command BAM from MCS: ref #627740
2018-11-25 22:47:12 [INFO    ] Finished processing BAM request
2018-11-25 22:47:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627740   8 58447 82032025 A  ERROR'
2018-11-25 22:47:12 [DEBUG   ] Got command BAM from MCS: ref #627739
2018-11-25 22:47:12 [INFO    ] Finished processing BAM request
2018-11-25 22:47:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:47:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627739   8 58447 82032029 A  ERROR'
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:47:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:47:12 [DEBUG   ] spawn_process: at 2018-11-25 22:47:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:47:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:47:27 [DEBUG   ] Got command RPT from MCS: ref #627741
2018-11-25 22:47:27 [DEBUG   ] summary = ERROR
2018-11-25 22:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627741  13 58447 82047477 A  ERRORERROR'
2018-11-25 22:47:27 [DEBUG   ] Got command RPT from MCS: ref #627742
2018-11-25 22:47:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627742  77 58447 82047681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:47:27 [DEBUG   ] Got command RPT from MCS: ref #627743
2018-11-25 22:47:27 [DEBUG   ] summary = ERROR
2018-11-25 22:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627743  13 58447 82047885 A  ERRORERROR'
2018-11-25 22:47:28 [DEBUG   ] Got command RPT from MCS: ref #627744
2018-11-25 22:47:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627744  77 58447 82048077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:47:28 [DEBUG   ] Got command RPT from MCS: ref #627745
2018-11-25 22:47:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627745  12 58447 82048281 A  ERRORB¡ff'
2018-11-25 22:47:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:47:44 [DEBUG   ] Got command BAM from MCS: ref #627746
2018-11-25 22:47:44 [INFO    ] Finished processing BAM request
2018-11-25 22:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627746   8 58447 82064025 A  ERROR'
2018-11-25 22:47:44 [DEBUG   ] Got command BAM from MCS: ref #627747
2018-11-25 22:47:44 [INFO    ] Finished processing BAM request
2018-11-25 22:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627747   8 58447 82064029 A  ERROR'
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:47:44 [DEBUG   ] spawn_process: at 2018-11-25 22:47:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:48:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:48:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:48:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:48:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:48:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:48:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:48:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:48:07 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-11-25 22:48:16 [DEBUG   ] Got command BAM from MCS: ref #627749
2018-11-25 22:48:16 [INFO    ] Finished processing BAM request
2018-11-25 22:48:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627749   8 58447 82096037 A  ERROR'
2018-11-25 22:48:16 [DEBUG   ] Got command BAM from MCS: ref #627748
2018-11-25 22:48:16 [INFO    ] Finished processing BAM request
2018-11-25 22:48:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627748   8 58447 82096045 A  ERROR'
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:48:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:48:16 [DEBUG   ] spawn_process: at 2018-11-25 22:48:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:48:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:48:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:48:48 [DEBUG   ] Got command BAM from MCS: ref #627755
2018-11-25 22:48:48 [INFO    ] Finished processing BAM request
2018-11-25 22:48:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627755   8 58447 82128029 A  ERROR'
2018-11-25 22:48:48 [DEBUG   ] Got command BAM from MCS: ref #627754
2018-11-25 22:48:48 [INFO    ] Finished processing BAM request
2018-11-25 22:48:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627754   8 58447 82128033 A  ERROR'
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:48:48 [DEBUG   ] spawn_process: at 2018-11-25 22:48:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:49:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 22:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 22:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-25 22:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:49:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:49:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:49:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:49:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:49:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:49:06 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-11-25 22:49:20 [DEBUG   ] Got command BAM from MCS: ref #627756
2018-11-25 22:49:20 [INFO    ] Finished processing BAM request
2018-11-25 22:49:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627756   8 58447 82160033 A  ERROR'
2018-11-25 22:49:20 [DEBUG   ] Got command BAM from MCS: ref #627757
2018-11-25 22:49:20 [INFO    ] Finished processing BAM request
2018-11-25 22:49:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627757   8 58447 82160037 A  ERROR'
2018-11-25 22:49:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:49:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:49:20 [DEBUG   ] spawn_process: at 2018-11-25 22:49:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:49:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:49:52 [DEBUG   ] Got command BAM from MCS: ref #627759
2018-11-25 22:49:52 [INFO    ] Finished processing BAM request
2018-11-25 22:49:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627759   8 58447 82192029 A  ERROR'
2018-11-25 22:49:52 [DEBUG   ] Got command BAM from MCS: ref #627758
2018-11-25 22:49:52 [INFO    ] Finished processing BAM request
2018-11-25 22:49:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627758   8 58447 82192033 A  ERROR'
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:49:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:49:52 [DEBUG   ] spawn_process: at 2018-11-25 22:49:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:50:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:50:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-25 22:50:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:50:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:50:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:50:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:50:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:50:06 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-25 22:50:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:50:24 [DEBUG   ] Got command BAM from MCS: ref #627760
2018-11-25 22:50:24 [INFO    ] Finished processing BAM request
2018-11-25 22:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627760   8 58447 82224025 A  ERROR'
2018-11-25 22:50:24 [DEBUG   ] Got command BAM from MCS: ref #627761
2018-11-25 22:50:24 [INFO    ] Finished processing BAM request
2018-11-25 22:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627761   8 58447 82224029 A  ERROR'
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:50:24 [DEBUG   ] spawn_process: at 2018-11-25 22:50:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:50:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 22:50:48 [DEBUG   ] Got command RPT from MCS: ref #627762
2018-11-25 22:50:48 [DEBUG   ] summary = ERROR
2018-11-25 22:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627762  13 58447 82248521 A  ERRORERROR'
2018-11-25 22:50:48 [DEBUG   ] Got command RPT from MCS: ref #627763
2018-11-25 22:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627763  77 58447 82248522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:50:56 [DEBUG   ] Got command BAM from MCS: ref #627780
2018-11-25 22:50:56 [INFO    ] Finished processing BAM request
2018-11-25 22:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627780   8 58447 82256025 A  ERROR'
2018-11-25 22:50:56 [DEBUG   ] Got command BAM from MCS: ref #627779
2018-11-25 22:50:56 [INFO    ] Finished processing BAM request
2018-11-25 22:50:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:50:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627779   8 58447 82256029 A  ERROR'
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:50:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:50:56 [DEBUG   ] spawn_process: at 2018-11-25 22:50:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:51:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-25 22:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:51:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:51:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:51:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:51:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:51:06 [WARNING ] (13, 1, 'bot')
2018-11-25 22:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:51:06 [DEBUG   ] Finished updating board flags in 0.979 seconds
2018-11-25 22:51:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 22:51:28 [DEBUG   ] Got command BAM from MCS: ref #627781
2018-11-25 22:51:28 [INFO    ] Finished processing BAM request
2018-11-25 22:51:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627781   8 58447 82288033 A  ERROR'
2018-11-25 22:51:28 [DEBUG   ] Got command BAM from MCS: ref #627782
2018-11-25 22:51:28 [INFO    ] Finished processing BAM request
2018-11-25 22:51:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:51:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627782   8 58447 82288037 A  ERROR'
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:51:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:51:28 [DEBUG   ] spawn_process: at 2018-11-25 22:51:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:51:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:52:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:52:01 [DEBUG   ] Got command BAM from MCS: ref #627787
2018-11-25 22:52:01 [INFO    ] Finished processing BAM request
2018-11-25 22:52:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627787   8 58447 82321029 A  ERROR'
2018-11-25 22:52:01 [DEBUG   ] Got command BAM from MCS: ref #627788
2018-11-25 22:52:01 [INFO    ] Finished processing BAM request
2018-11-25 22:52:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627788   8 58447 82321033 A  ERROR'
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:52:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:52:01 [DEBUG   ] spawn_process: at 2018-11-25 22:52:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:52:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:52:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:52:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:52:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:52:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:52:07 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-25 22:52:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:52:27 [DEBUG   ] Got command RPT from MCS: ref #627791
2018-11-25 22:52:27 [DEBUG   ] summary = ERROR
2018-11-25 22:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627791  13 58447 82347561 A  ERRORERROR'
2018-11-25 22:52:27 [DEBUG   ] Got command RPT from MCS: ref #627792
2018-11-25 22:52:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627792  77 58447 82347765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:52:27 [DEBUG   ] Got command RPT from MCS: ref #627793
2018-11-25 22:52:27 [DEBUG   ] summary = ERROR
2018-11-25 22:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627793  13 58447 82347969 A  ERRORERROR'
2018-11-25 22:52:28 [DEBUG   ] Got command RPT from MCS: ref #627795
2018-11-25 22:52:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627795  77 58447 82348173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:52:28 [DEBUG   ] Got command RPT from MCS: ref #627796
2018-11-25 22:52:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627796  12 58447 82348365 A  ERRORB¡ff'
2018-11-25 22:52:34 [DEBUG   ] Got command BAM from MCS: ref #627802
2018-11-25 22:52:34 [INFO    ] Finished processing BAM request
2018-11-25 22:52:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627802   8 58447 82354033 A  ERROR'
2018-11-25 22:52:34 [DEBUG   ] Got command BAM from MCS: ref #627801
2018-11-25 22:52:34 [INFO    ] Finished processing BAM request
2018-11-25 22:52:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627801   8 58447 82354037 A  ERROR'
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:52:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:52:34 [DEBUG   ] spawn_process: at 2018-11-25 22:52:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:52:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:53:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2018-11-25 22:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:53:07 [DEBUG   ] Got command BAM from MCS: ref #627803
2018-11-25 22:53:07 [INFO    ] Finished processing BAM request
2018-11-25 22:53:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627803   8 58447 82387029 A  ERROR'
2018-11-25 22:53:07 [DEBUG   ] Got command BAM from MCS: ref #627804
2018-11-25 22:53:07 [INFO    ] Finished processing BAM request
2018-11-25 22:53:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627804   8 58447 82387033 A  ERROR'
2018-11-25 22:53:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:53:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:53:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:53:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:53:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:53:07 [DEBUG   ] Finished updating board flags in 1.268 seconds
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:53:07 [DEBUG   ] spawn_process: at 2018-11-25 22:53:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 22:53:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 22:53:40 [DEBUG   ] Got command BAM from MCS: ref #627805
2018-11-25 22:53:40 [INFO    ] Finished processing BAM request
2018-11-25 22:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627805   8 58447 82420029 A  ERROR'
2018-11-25 22:53:40 [DEBUG   ] Got command BAM from MCS: ref #627806
2018-11-25 22:53:40 [INFO    ] Finished processing BAM request
2018-11-25 22:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627806   8 58447 82420033 A  ERROR'
2018-11-25 22:53:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 22:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 22:53:40 [DEBUG   ] spawn_process: at 2018-11-25 22:53:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 22:54:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:54:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:54:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:54:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:54:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:54:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:54:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:54:07 [DEBUG   ] Finished updating board flags in 1.129 seconds
2018-11-25 22:54:13 [DEBUG   ] Got command BAM from MCS: ref #627808
2018-11-25 22:54:13 [INFO    ] Finished processing BAM request
2018-11-25 22:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627808   8 58447 82453033 A  ERROR'
2018-11-25 22:54:13 [DEBUG   ] Got command BAM from MCS: ref #627807
2018-11-25 22:54:13 [INFO    ] Finished processing BAM request
2018-11-25 22:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627807   8 58447 82453037 A  ERROR'
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:54:13 [DEBUG   ] spawn_process: at 2018-11-25 22:54:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:54:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 22:54:41 [DEBUG   ] Finished updating ant stats in 1.222 seconds
2018-11-25 22:54:46 [DEBUG   ] Got command BAM from MCS: ref #627814
2018-11-25 22:54:46 [INFO    ] Finished processing BAM request
2018-11-25 22:54:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627814   8 58447 82486029 A  ERROR'
2018-11-25 22:54:46 [DEBUG   ] Got command BAM from MCS: ref #627813
2018-11-25 22:54:46 [INFO    ] Finished processing BAM request
2018-11-25 22:54:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627813   8 58447 82486033 A  ERROR'
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:54:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:54:46 [DEBUG   ] spawn_process: at 2018-11-25 22:54:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:55:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 22:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 22:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 22:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:55:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:55:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:55:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:55:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:55:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:55:07 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-25 22:55:19 [DEBUG   ] Got command BAM from MCS: ref #627815
2018-11-25 22:55:19 [INFO    ] Finished processing BAM request
2018-11-25 22:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627815   8 58447 82519025 A  ERROR'
2018-11-25 22:55:19 [DEBUG   ] Got command BAM from MCS: ref #627816
2018-11-25 22:55:19 [INFO    ] Finished processing BAM request
2018-11-25 22:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627816   8 58447 82519029 A  ERROR'
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:55:19 [DEBUG   ] spawn_process: at 2018-11-25 22:55:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:55:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:55:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:55:48 [DEBUG   ] Got command RPT from MCS: ref #627817
2018-11-25 22:55:48 [DEBUG   ] summary = ERROR
2018-11-25 22:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627817  13 58447 82548529 A  ERRORERROR'
2018-11-25 22:55:48 [DEBUG   ] Got command RPT from MCS: ref #627818
2018-11-25 22:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627818  77 58447 82548530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:55:52 [DEBUG   ] Got command BAM from MCS: ref #627835
2018-11-25 22:55:52 [INFO    ] Finished processing BAM request
2018-11-25 22:55:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:55:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627835   8 58447 82552025 A  ERROR'
2018-11-25 22:55:52 [DEBUG   ] Got command BAM from MCS: ref #627834
2018-11-25 22:55:52 [INFO    ] Finished processing BAM request
2018-11-25 22:55:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:55:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627834   8 58447 82552029 A  ERROR'
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:55:52 [DEBUG   ] spawn_process: at 2018-11-25 22:55:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:56:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-25 22:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:56:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 22:56:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:56:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:56:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:56:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:56:07 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-25 22:56:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:56:25 [DEBUG   ] Got command BAM from MCS: ref #627836
2018-11-25 22:56:25 [INFO    ] Finished processing BAM request
2018-11-25 22:56:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627836   8 58447 82585029 A  ERROR'
2018-11-25 22:56:25 [DEBUG   ] Got command BAM from MCS: ref #627837
2018-11-25 22:56:25 [INFO    ] Finished processing BAM request
2018-11-25 22:56:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627837   8 58447 82585033 A  ERROR'
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:56:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:56:25 [DEBUG   ] spawn_process: at 2018-11-25 22:56:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:56:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:56:58 [DEBUG   ] Got command BAM from MCS: ref #627838
2018-11-25 22:56:58 [INFO    ] Finished processing BAM request
2018-11-25 22:56:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627838   8 58447 82618025 A  ERROR'
2018-11-25 22:56:58 [DEBUG   ] Got command BAM from MCS: ref #627839
2018-11-25 22:56:58 [INFO    ] Finished processing BAM request
2018-11-25 22:56:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:56:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627839   8 58447 82618029 A  ERROR'
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 22:56:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 22:56:58 [DEBUG   ] spawn_process: at 2018-11-25 22:56:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 22:57:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 22:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:57:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 22:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 22:57:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:57:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:57:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:57:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:57:07 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-25 22:57:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:57:27 [DEBUG   ] Got command RPT from MCS: ref #627840
2018-11-25 22:57:27 [DEBUG   ] summary = ERROR
2018-11-25 22:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627840  13 58447 82647653 A  ERRORERROR'
2018-11-25 22:57:27 [DEBUG   ] Got command RPT from MCS: ref #627841
2018-11-25 22:57:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627841  77 58447 82647857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:57:28 [DEBUG   ] Got command RPT from MCS: ref #627842
2018-11-25 22:57:28 [DEBUG   ] summary = ERROR
2018-11-25 22:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627842  13 58447 82648061 A  ERRORERROR'
2018-11-25 22:57:28 [DEBUG   ] Got command RPT from MCS: ref #627843
2018-11-25 22:57:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 22:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627843  77 58447 82648253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 22:57:28 [DEBUG   ] Got command RPT from MCS: ref #627844
2018-11-25 22:57:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 22:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627844  12 58447 82648457 A  ERRORB¡ff'
2018-11-25 22:57:31 [DEBUG   ] Got command BAM from MCS: ref #627845
2018-11-25 22:57:31 [INFO    ] Finished processing BAM request
2018-11-25 22:57:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627845   8 58447 82651029 A  ERROR'
2018-11-25 22:57:31 [DEBUG   ] Got command BAM from MCS: ref #627846
2018-11-25 22:57:31 [INFO    ] Finished processing BAM request
2018-11-25 22:57:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627846   8 58447 82651033 A  ERROR'
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:57:31 [DEBUG   ] spawn_process: at 2018-11-25 22:57:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:57:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:58:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:58:04 [DEBUG   ] Got command BAM from MCS: ref #627852
2018-11-25 22:58:04 [INFO    ] Finished processing BAM request
2018-11-25 22:58:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627852   8 58447 82684029 A  ERROR'
2018-11-25 22:58:04 [DEBUG   ] Got command BAM from MCS: ref #627851
2018-11-25 22:58:04 [INFO    ] Finished processing BAM request
2018-11-25 22:58:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627851   8 58447 82684033 A  ERROR'
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:58:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:58:04 [DEBUG   ] spawn_process: at 2018-11-25 22:58:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:58:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:58:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:58:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:58:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:58:07 [WARNING ] (13, 1, 'bot')
2018-11-25 22:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:58:07 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-25 22:58:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:58:37 [DEBUG   ] Got command BAM from MCS: ref #627854
2018-11-25 22:58:37 [INFO    ] Finished processing BAM request
2018-11-25 22:58:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627854   8 58447 82717025 A  ERROR'
2018-11-25 22:58:37 [DEBUG   ] Got command BAM from MCS: ref #627853
2018-11-25 22:58:37 [INFO    ] Finished processing BAM request
2018-11-25 22:58:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627853   8 58447 82717029 A  ERROR'
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 22:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 22:58:37 [DEBUG   ] spawn_process: at 2018-11-25 22:58:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 22:58:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:59:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-25 22:59:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 22:59:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 22:59:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 22:59:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 22:59:08 [WARNING ] (13, 1, 'bot')
2018-11-25 22:59:08 [WARNING ] (13, 1, 'bot')
2018-11-25 22:59:08 [WARNING ] (13, 1, 'bot')
2018-11-25 22:59:08 [WARNING ] (13, 1, 'bot')
2018-11-25 22:59:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 22:59:08 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-11-25 22:59:10 [DEBUG   ] Got command BAM from MCS: ref #627856
2018-11-25 22:59:10 [INFO    ] Finished processing BAM request
2018-11-25 22:59:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627856   8 58447 82750033 A  ERROR'
2018-11-25 22:59:10 [DEBUG   ] Got command BAM from MCS: ref #627855
2018-11-25 22:59:10 [INFO    ] Finished processing BAM request
2018-11-25 22:59:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627855   8 58447 82750037 A  ERROR'
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 22:59:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 22:59:10 [DEBUG   ] spawn_process: at 2018-11-25 22:59:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 22:59:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 22:59:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 22:59:43 [DEBUG   ] Got command BAM from MCS: ref #627857
2018-11-25 22:59:43 [INFO    ] Finished processing BAM request
2018-11-25 22:59:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627857   8 58447 82783025 A  ERROR'
2018-11-25 22:59:43 [DEBUG   ] Got command BAM from MCS: ref #627858
2018-11-25 22:59:43 [INFO    ] Finished processing BAM request
2018-11-25 22:59:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 22:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627858   8 58447 82783029 A  ERROR'
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 22:59:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 22:59:43 [DEBUG   ] spawn_process: at 2018-11-25 22:59:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 23:00:01 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-11-25 23:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:00:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-25 23:00:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-25 23:00:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:00:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:00:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:00:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:00:07 [DEBUG   ] Finished updating board flags in 1.229 seconds
2018-11-25 23:00:16 [DEBUG   ] Got command BAM from MCS: ref #627859
2018-11-25 23:00:16 [INFO    ] Finished processing BAM request
2018-11-25 23:00:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627859   8 58447 82816029 A  ERROR'
2018-11-25 23:00:16 [DEBUG   ] Got command BAM from MCS: ref #627860
2018-11-25 23:00:16 [INFO    ] Finished processing BAM request
2018-11-25 23:00:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627860   8 58447 82816033 A  ERROR'
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 23:00:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 23:00:16 [DEBUG   ] spawn_process: at 2018-11-25 23:00:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 23:00:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 23:00:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:00:48 [DEBUG   ] Got command RPT from MCS: ref #627867
2018-11-25 23:00:48 [DEBUG   ] summary = ERROR
2018-11-25 23:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627867  13 58447 82848533 A  ERRORERROR'
2018-11-25 23:00:48 [DEBUG   ] Got command RPT from MCS: ref #627868
2018-11-25 23:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627868  77 58447 82848534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:00:49 [DEBUG   ] Got command BAM from MCS: ref #627865
2018-11-25 23:00:49 [INFO    ] Finished processing BAM request
2018-11-25 23:00:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627865   8 58447 82849029 A  ERROR'
2018-11-25 23:00:49 [DEBUG   ] Got command BAM from MCS: ref #627866
2018-11-25 23:00:49 [INFO    ] Finished processing BAM request
2018-11-25 23:00:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:00:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627866   8 58447 82849033 A  ERROR'
2018-11-25 23:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 23:00:49 [DEBUG   ] spawn_process: at 2018-11-25 23:00:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 23:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 23:00:49 [DEBUG   ] spawn_process: at 2018-11-25 23:00:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 23:00:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 23:00:49 [DEBUG   ] spawn_process: at 2018-11-25 23:00:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 23:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 23:00:50 [DEBUG   ] spawn_process: at 2018-11-25 23:00:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 23:01:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-25 23:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:01:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 23:01:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:01:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:01:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:01:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:01:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:01:07 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-11-25 23:01:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:01:22 [DEBUG   ] Got command BAM from MCS: ref #627884
2018-11-25 23:01:22 [INFO    ] Finished processing BAM request
2018-11-25 23:01:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:01:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627884   8 58447 82882025 A  ERROR'
2018-11-25 23:01:22 [DEBUG   ] Got command BAM from MCS: ref #627885
2018-11-25 23:01:22 [INFO    ] Finished processing BAM request
2018-11-25 23:01:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:01:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627885   8 58447 82882029 A  ERROR'
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 23:01:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 23:01:22 [DEBUG   ] spawn_process: at 2018-11-25 23:01:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 23:01:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:01:55 [DEBUG   ] Got command BAM from MCS: ref #627886
2018-11-25 23:01:55 [INFO    ] Finished processing BAM request
2018-11-25 23:01:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627886   8 58447 82915025 A  ERROR'
2018-11-25 23:01:55 [DEBUG   ] Got command BAM from MCS: ref #627887
2018-11-25 23:01:55 [INFO    ] Finished processing BAM request
2018-11-25 23:01:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627887   8 58447 82915029 A  ERROR'
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 23:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 23:01:55 [DEBUG   ] spawn_process: at 2018-11-25 23:01:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 23:02:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-25 23:02:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-25 23:02:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:02:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:02:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:02:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:02:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:02:07 [DEBUG   ] Finished updating board flags in 1.178 seconds
2018-11-25 23:02:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-25 23:02:27 [DEBUG   ] Got command RPT from MCS: ref #627890
2018-11-25 23:02:27 [DEBUG   ] summary = ERROR
2018-11-25 23:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627890  13 58447 82947733 A  ERRORERROR'
2018-11-25 23:02:27 [DEBUG   ] Got command RPT from MCS: ref #627891
2018-11-25 23:02:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627891  77 58447 82947937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:02:28 [DEBUG   ] Got command RPT from MCS: ref #627894
2018-11-25 23:02:28 [DEBUG   ] summary = ERROR
2018-11-25 23:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627894  13 58447 82948141 A  ERRORERROR'
2018-11-25 23:02:28 [DEBUG   ] Got command RPT from MCS: ref #627896
2018-11-25 23:02:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627896  77 58447 82948345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:02:28 [DEBUG   ] Got command RPT from MCS: ref #627897
2018-11-25 23:02:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627897  12 58447 82948537 A  ERRORB ff'
2018-11-25 23:02:29 [DEBUG   ] Got command BAM from MCS: ref #627893
2018-11-25 23:02:29 [INFO    ] Finished processing BAM request
2018-11-25 23:02:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627893   8 58447 82949033 A  ERROR'
2018-11-25 23:02:29 [DEBUG   ] Got command BAM from MCS: ref #627892
2018-11-25 23:02:29 [INFO    ] Finished processing BAM request
2018-11-25 23:02:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627892   8 58447 82949037 A  ERROR'
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 23:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 23:02:29 [DEBUG   ] spawn_process: at 2018-11-25 23:02:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 23:02:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-25 23:03:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-25 23:03:03 [DEBUG   ] Got command BAM from MCS: ref #627902
2018-11-25 23:03:03 [INFO    ] Finished processing BAM request
2018-11-25 23:03:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627902   8 58447 82983033 A  ERROR'
2018-11-25 23:03:03 [DEBUG   ] Got command BAM from MCS: ref #627903
2018-11-25 23:03:03 [INFO    ] Finished processing BAM request
2018-11-25 23:03:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627903   8 58447 82983037 A  ERROR'
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 23:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 23:03:03 [DEBUG   ] spawn_process: at 2018-11-25 23:03:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 23:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 23:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:03:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 23:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-25 23:03:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:03:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:03:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:03:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:03:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:03:07 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-11-25 23:03:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-25 23:03:37 [DEBUG   ] Got command BAM from MCS: ref #627904
2018-11-25 23:03:37 [INFO    ] Finished processing BAM request
2018-11-25 23:03:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627904   8 58447 83017029 A  ERROR'
2018-11-25 23:03:37 [DEBUG   ] Got command BAM from MCS: ref #627905
2018-11-25 23:03:37 [INFO    ] Finished processing BAM request
2018-11-25 23:03:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627905   8 58447 83017033 A  ERROR'
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-25 23:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-25 23:03:37 [DEBUG   ] spawn_process: at 2018-11-25 23:03:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-25 23:03:41 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 23:04:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-25 23:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:04:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 23:04:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:04:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:04:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:04:07 [WARNING ] (13, 1, 'bot')
2018-11-25 23:04:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:04:07 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-11-25 23:04:11 [DEBUG   ] Got command BAM from MCS: ref #627910
2018-11-25 23:04:11 [INFO    ] Finished processing BAM request
2018-11-25 23:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627910   8 58447 83051029 A  ERROR'
2018-11-25 23:04:11 [DEBUG   ] Got command BAM from MCS: ref #627911
2018-11-25 23:04:11 [INFO    ] Finished processing BAM request
2018-11-25 23:04:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627911   8 58447 83051033 A  ERROR'
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-25 23:04:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-25 23:04:11 [DEBUG   ] spawn_process: at 2018-11-25 23:04:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-25 23:04:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:04:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:04:45 [DEBUG   ] Got command BAM from MCS: ref #627913
2018-11-25 23:04:45 [INFO    ] Finished processing BAM request
2018-11-25 23:04:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627913   8 58447 83085033 A  ERROR'
2018-11-25 23:04:45 [DEBUG   ] Got command BAM from MCS: ref #627912
2018-11-25 23:04:45 [INFO    ] Finished processing BAM request
2018-11-25 23:04:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627912   8 58447 83085037 A  ERROR'
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-25 23:04:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-25 23:04:45 [DEBUG   ] spawn_process: at 2018-11-25 23:04:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-25 23:05:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:05:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-25 23:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:05:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-25 23:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-25 23:05:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-25 23:05:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:05:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:05:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:05:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:05:08 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-11-25 23:05:19 [DEBUG   ] Got command BAM from MCS: ref #627915
2018-11-25 23:05:19 [INFO    ] Finished processing BAM request
2018-11-25 23:05:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627915   8 58447 83119046 A  ERROR'
2018-11-25 23:05:19 [DEBUG   ] Got command BAM from MCS: ref #627914
2018-11-25 23:05:19 [INFO    ] Finished processing BAM request
2018-11-25 23:05:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627914   8 58447 83119050 A  ERROR'
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 23:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 23:05:19 [DEBUG   ] spawn_process: at 2018-11-25 23:05:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 23:05:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:05:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:05:48 [DEBUG   ] Got command RPT from MCS: ref #627916
2018-11-25 23:05:48 [DEBUG   ] summary = ERROR
2018-11-25 23:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627916  13 58447 83148533 A  ERRORERROR'
2018-11-25 23:05:48 [DEBUG   ] Got command RPT from MCS: ref #627917
2018-11-25 23:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627917  77 58447 83148534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:05:53 [DEBUG   ] Got command BAM from MCS: ref #627934
2018-11-25 23:05:53 [INFO    ] Finished processing BAM request
2018-11-25 23:05:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:05:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627934   8 58447 83153026 A  ERROR'
2018-11-25 23:05:53 [DEBUG   ] Got command BAM from MCS: ref #627933
2018-11-25 23:05:53 [INFO    ] Finished processing BAM request
2018-11-25 23:05:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-25 23:05:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   627933   8 58447 83153030 A  ERROR'
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-25 23:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-25 23:05:53 [DEBUG   ] spawn_process: at 2018-11-25 23:05:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-25 23:06:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 23:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:06:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-25 23:06:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 23:06:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:06:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:06:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:06:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:06:08 [DEBUG   ] Finished updating board flags in 1.328 seconds
2018-11-25 23:06:17 [DEBUG   ] Got command STP from MCS: ref #627936
2018-11-25 23:06:17 [INFO    ] Finished processing BAM request
2018-11-25 23:06:17 [INFO    ] Shutdown the adder chain on beam #2
2018-11-25 23:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   627936   8 58447 83177117 A  ERROR'
2018-11-25 23:06:17 [DEBUG   ] Got command STP from MCS: ref #627935
2018-11-25 23:06:17 [INFO    ] Finished processing BAM request
2018-11-25 23:06:17 [INFO    ] Shutdown the adder chain on beam #3
2018-11-25 23:06:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   627935   8 58447 83177121 A  ERROR'
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-25 23:06:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-25 23:06:17 [DEBUG   ] spawn_process: at 2018-11-25 23:06:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-25 23:06:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:06:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:07:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:07:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:07:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:07:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:07:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:07:08 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-11-25 23:07:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:07:27 [DEBUG   ] Got command RPT from MCS: ref #627941
2018-11-25 23:07:27 [DEBUG   ] summary = ERROR
2018-11-25 23:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627941  13 58447 83247825 A  ERRORERROR'
2018-11-25 23:07:28 [DEBUG   ] Got command RPT from MCS: ref #627942
2018-11-25 23:07:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627942  77 58447 83248018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:07:28 [DEBUG   ] Got command RPT from MCS: ref #627943
2018-11-25 23:07:28 [DEBUG   ] summary = ERROR
2018-11-25 23:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627943  13 58447 83248222 A  ERRORERROR'
2018-11-25 23:07:28 [DEBUG   ] Got command RPT from MCS: ref #627944
2018-11-25 23:07:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627944  77 58447 83248425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:07:28 [DEBUG   ] Got command RPT from MCS: ref #627945
2018-11-25 23:07:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627945  12 58447 83248629 A  ERRORBžff'
2018-11-25 23:07:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 23:08:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:08:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 23:08:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 23:08:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:08:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:08:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:08:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:08:08 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-25 23:08:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:08:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:09:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 23:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:09:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 23:09:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 23:09:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:09:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:09:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:09:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:09:08 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-11-25 23:09:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:09:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 23:10:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 23:10:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:10:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:10:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:10:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:10:08 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-25 23:10:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:10:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:10:48 [DEBUG   ] Got command RPT from MCS: ref #627950
2018-11-25 23:10:48 [DEBUG   ] summary = ERROR
2018-11-25 23:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627950  13 58447 83448525 A  ERRORERROR'
2018-11-25 23:10:48 [DEBUG   ] Got command RPT from MCS: ref #627951
2018-11-25 23:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627951  77 58447 83448526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:11:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 23:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:11:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:11:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:11:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:11:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:11:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:11:09 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-11-25 23:11:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:11:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:12:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:12:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:12:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:12:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:12:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:12:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:12:09 [DEBUG   ] Finished updating board flags in 1.925 seconds
2018-11-25 23:12:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:12:27 [DEBUG   ] Got command RPT from MCS: ref #627969
2018-11-25 23:12:27 [DEBUG   ] summary = ERROR
2018-11-25 23:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627969  13 58447 83547905 A  ERRORERROR'
2018-11-25 23:12:28 [DEBUG   ] Got command RPT from MCS: ref #627970
2018-11-25 23:12:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627970  77 58447 83548097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:12:28 [DEBUG   ] Got command RPT from MCS: ref #627971
2018-11-25 23:12:28 [DEBUG   ] summary = ERROR
2018-11-25 23:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627971  13 58447 83548301 A  ERRORERROR'
2018-11-25 23:12:28 [DEBUG   ] Got command RPT from MCS: ref #627973
2018-11-25 23:12:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627973  77 58447 83548505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:12:28 [DEBUG   ] Got command RPT from MCS: ref #627974
2018-11-25 23:12:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627974  12 58447 83548709 A  ERRORB™™š'
2018-11-25 23:12:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:13:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 23:13:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 23:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:13:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:13:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:13:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:13:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:13:08 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-11-25 23:13:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:13:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:14:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:14:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:14:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:14:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:14:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:14:09 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-11-25 23:14:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:14:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:15:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 23:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:15:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:15:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:15:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:15:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:15:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:15:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:15:08 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-11-25 23:15:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-25 23:15:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:15:48 [DEBUG   ] Got command RPT from MCS: ref #627987
2018-11-25 23:15:48 [DEBUG   ] summary = ERROR
2018-11-25 23:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627987  13 58447 83748525 A  ERRORERROR'
2018-11-25 23:15:48 [DEBUG   ] Got command RPT from MCS: ref #627988
2018-11-25 23:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   627988  77 58447 83748526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:16:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:16:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:16:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:16:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:16:08 [WARNING ] (13, 1, 'bot')
2018-11-25 23:16:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:16:08 [DEBUG   ] Finished updating board flags in 1.072 seconds
2018-11-25 23:16:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:16:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:17:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:17:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:17:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:17:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:17:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:17:09 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-11-25 23:17:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-25 23:17:27 [DEBUG   ] Got command RPT from MCS: ref #628004
2018-11-25 23:17:27 [DEBUG   ] summary = ERROR
2018-11-25 23:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628004  13 58447 83847977 A  ERRORERROR'
2018-11-25 23:17:28 [DEBUG   ] Got command RPT from MCS: ref #628005
2018-11-25 23:17:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628005  77 58447 83848181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:17:28 [DEBUG   ] Got command RPT from MCS: ref #628006
2018-11-25 23:17:28 [DEBUG   ] summary = ERROR
2018-11-25 23:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628006  13 58447 83848385 A  ERRORERROR'
2018-11-25 23:17:28 [DEBUG   ] Got command RPT from MCS: ref #628007
2018-11-25 23:17:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628007  77 58447 83848589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:17:28 [DEBUG   ] Got command RPT from MCS: ref #628008
2018-11-25 23:17:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628008  12 58447 83848781 A  ERRORB˜™š'
2018-11-25 23:17:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:18:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:18:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:18:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:18:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:18:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:18:09 [DEBUG   ] Finished updating board flags in 1.346 seconds
2018-11-25 23:18:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:18:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:19:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:19:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:19:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:19:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:19:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:19:09 [DEBUG   ] Finished updating board flags in 1.231 seconds
2018-11-25 23:19:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:19:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:20:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:20:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 23:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:20:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:20:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:20:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:20:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:20:09 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-25 23:20:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:20:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:20:48 [DEBUG   ] Got command RPT from MCS: ref #628013
2018-11-25 23:20:48 [DEBUG   ] summary = ERROR
2018-11-25 23:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628013  13 58447 84048533 A  ERRORERROR'
2018-11-25 23:20:48 [DEBUG   ] Got command RPT from MCS: ref #628014
2018-11-25 23:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628014  77 58447 84048534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:21:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:21:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-25 23:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:21:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:21:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:21:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:21:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:21:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:21:09 [DEBUG   ] Finished updating board flags in 1.164 seconds
2018-11-25 23:21:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:21:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:22:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:22:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:22:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:22:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:22:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:22:09 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-11-25 23:22:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:22:28 [DEBUG   ] Got command RPT from MCS: ref #628036
2018-11-25 23:22:28 [DEBUG   ] summary = ERROR
2018-11-25 23:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628036  13 58447 84148057 A  ERRORERROR'
2018-11-25 23:22:28 [DEBUG   ] Got command RPT from MCS: ref #628037
2018-11-25 23:22:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628037  77 58447 84148261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:22:28 [DEBUG   ] Got command RPT from MCS: ref #628038
2018-11-25 23:22:28 [DEBUG   ] summary = ERROR
2018-11-25 23:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628038  13 58447 84148465 A  ERRORERROR'
2018-11-25 23:22:28 [DEBUG   ] Got command RPT from MCS: ref #628040
2018-11-25 23:22:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628040  77 58447 84148669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:22:28 [DEBUG   ] Got command RPT from MCS: ref #628041
2018-11-25 23:22:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628041  12 58447 84148861 A  ERRORB—™š'
2018-11-25 23:22:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:23:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:23:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:23:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:23:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:23:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:23:10 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-11-25 23:23:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:23:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:24:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-25 23:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:24:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:24:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:24:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:24:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:24:09 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-25 23:24:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:24:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:25:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:25:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:25:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:25:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:25:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:25:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:25:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:25:09 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-11-25 23:25:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:25:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:25:48 [DEBUG   ] Got command RPT from MCS: ref #628050
2018-11-25 23:25:48 [DEBUG   ] summary = ERROR
2018-11-25 23:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628050  13 58447 84348529 A  ERRORERROR'
2018-11-25 23:25:48 [DEBUG   ] Got command RPT from MCS: ref #628051
2018-11-25 23:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628051  77 58447 84348530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:26:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:26:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:26:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:26:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:26:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:26:09 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-11-25 23:26:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:26:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:27:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:27:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:27:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:27:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:27:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:27:09 [WARNING ] (13, 1, 'bot')
2018-11-25 23:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:27:09 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-11-25 23:27:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:27:28 [DEBUG   ] Got command RPT from MCS: ref #628067
2018-11-25 23:27:28 [DEBUG   ] summary = ERROR
2018-11-25 23:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628067  13 58447 84448149 A  ERRORERROR'
2018-11-25 23:27:28 [DEBUG   ] Got command RPT from MCS: ref #628068
2018-11-25 23:27:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628068  77 58447 84448341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:27:28 [DEBUG   ] Got command RPT from MCS: ref #628069
2018-11-25 23:27:28 [DEBUG   ] summary = ERROR
2018-11-25 23:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628069  13 58447 84448545 A  ERRORERROR'
2018-11-25 23:27:28 [DEBUG   ] Got command RPT from MCS: ref #628070
2018-11-25 23:27:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628070  77 58447 84448749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:27:28 [DEBUG   ] Got command RPT from MCS: ref #628071
2018-11-25 23:27:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628071  12 58447 84448941 A  ERRORB—™š'
2018-11-25 23:27:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:28:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:28:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:28:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:28:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:28:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:28:10 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-11-25 23:28:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:28:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:29:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:29:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 23:29:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:29:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:29:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:29:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:29:10 [DEBUG   ] Finished updating board flags in 1.322 seconds
2018-11-25 23:29:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:29:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:30:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:30:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:30:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:30:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:30:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:30:10 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-25 23:30:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:30:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:30:48 [DEBUG   ] Got command RPT from MCS: ref #628080
2018-11-25 23:30:48 [DEBUG   ] summary = ERROR
2018-11-25 23:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628080  13 58447 84648529 A  ERRORERROR'
2018-11-25 23:30:48 [DEBUG   ] Got command RPT from MCS: ref #628081
2018-11-25 23:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628081  77 58447 84648530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:31:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:31:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:31:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:31:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:31:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:31:10 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-25 23:31:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:31:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:32:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-25 23:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 23:32:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:32:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:32:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:32:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:32:10 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-25 23:32:11 [DEBUG   ] Got command TBW from MCS: ref #628100
2018-11-25 23:32:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-11-25 23:32:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   628100   8 58447 84731937 A  ERROR'
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-11-25 23:32:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-11-25 23:32:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-11-25 23:32:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-11-25 23:32:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-11-25 23:32:14 [DEBUG   ] spawn_process: at 2018-11-25 23:32:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-11-25 23:32:14 [INFO    ] Finished spawning TBW
2018-11-25 23:32:28 [DEBUG   ] Got command RPT from MCS: ref #628102
2018-11-25 23:32:28 [DEBUG   ] summary = ERROR
2018-11-25 23:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628102  13 58447 84748221 A  ERRORERROR'
2018-11-25 23:32:28 [DEBUG   ] Got command RPT from MCS: ref #628103
2018-11-25 23:32:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628103  77 58447 84748425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:32:28 [DEBUG   ] Got command RPT from MCS: ref #628104
2018-11-25 23:32:28 [DEBUG   ] summary = ERROR
2018-11-25 23:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628104  13 58447 84748629 A  ERRORERROR'
2018-11-25 23:32:28 [DEBUG   ] Got command RPT from MCS: ref #628106
2018-11-25 23:32:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628106  77 58447 84748821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:32:29 [DEBUG   ] Got command RPT from MCS: ref #628108
2018-11-25 23:32:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628108  12 58447 84749025 A  ERRORB˜™š'
2018-11-25 23:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:33:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:33:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:33:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:33:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:33:10 [DEBUG   ] Finished updating board flags in 1.282 seconds
2018-11-25 23:34:02 [INFO    ] __waitForTBW - TBW finished in 108.683 s
2018-11-25 23:34:03 [DEBUG   ] Finished updating ant stats in 0.443 seconds
2018-11-25 23:34:03 [INFO    ] Started antennas statistics background thread
2018-11-25 23:34:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 23:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:34:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:34:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:34:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:34:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:34:11 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-25 23:34:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:34:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:35:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 23:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:35:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:35:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:35:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:35:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:35:10 [DEBUG   ] Finished updating board flags in 1.157 seconds
2018-11-25 23:35:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:35:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:35:48 [DEBUG   ] Got command RPT from MCS: ref #628122
2018-11-25 23:35:48 [DEBUG   ] summary = ERROR
2018-11-25 23:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628122  13 58447 84948533 A  ERRORERROR'
2018-11-25 23:35:48 [DEBUG   ] Got command RPT from MCS: ref #628123
2018-11-25 23:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628123  77 58447 84948534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:36:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:36:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:36:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:36:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:36:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:36:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:36:10 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-11-25 23:36:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:36:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:37:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:37:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 23:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:37:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:37:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:37:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:37:10 [WARNING ] (13, 1, 'bot')
2018-11-25 23:37:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:37:10 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-11-25 23:37:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:37:28 [DEBUG   ] Got command RPT from MCS: ref #628143
2018-11-25 23:37:28 [DEBUG   ] summary = ERROR
2018-11-25 23:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628143  13 58447 85048309 A  ERRORERROR'
2018-11-25 23:37:28 [DEBUG   ] Got command RPT from MCS: ref #628144
2018-11-25 23:37:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628144  77 58447 85048501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:37:28 [DEBUG   ] Got command RPT from MCS: ref #628145
2018-11-25 23:37:28 [DEBUG   ] summary = ERROR
2018-11-25 23:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628145  13 58447 85048705 A  ERRORERROR'
2018-11-25 23:37:28 [DEBUG   ] Got command RPT from MCS: ref #628146
2018-11-25 23:37:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628146  77 58447 85048909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:37:29 [DEBUG   ] Got command RPT from MCS: ref #628147
2018-11-25 23:37:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628147  12 58447 85049113 A  ERRORB˜™š'
2018-11-25 23:37:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:38:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:38:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:38:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:38:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:38:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:38:11 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-25 23:38:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:38:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:39:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:39:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:39:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:39:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:39:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:39:11 [DEBUG   ] Finished updating board flags in 1.255 seconds
2018-11-25 23:39:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:39:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:40:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:40:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:40:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:40:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:40:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:40:11 [DEBUG   ] Finished updating board flags in 1.151 seconds
2018-11-25 23:40:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:40:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:40:48 [DEBUG   ] Got command RPT from MCS: ref #628152
2018-11-25 23:40:48 [DEBUG   ] summary = ERROR
2018-11-25 23:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628152  13 58447 85248541 A  ERRORERROR'
2018-11-25 23:40:48 [DEBUG   ] Got command RPT from MCS: ref #628153
2018-11-25 23:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628153  77 58447 85248542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:41:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-25 23:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:41:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:41:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:41:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:41:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:41:11 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-11-25 23:41:23 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-25 23:41:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:42:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:42:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:42:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:42:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:42:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:42:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:42:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:42:12 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-25 23:42:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:42:28 [DEBUG   ] Got command RPT from MCS: ref #628171
2018-11-25 23:42:28 [DEBUG   ] summary = ERROR
2018-11-25 23:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628171  13 58447 85348389 A  ERRORERROR'
2018-11-25 23:42:28 [DEBUG   ] Got command RPT from MCS: ref #628172
2018-11-25 23:42:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628172  77 58447 85348581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:42:28 [DEBUG   ] Got command RPT from MCS: ref #628173
2018-11-25 23:42:28 [DEBUG   ] summary = ERROR
2018-11-25 23:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628173  13 58447 85348785 A  ERRORERROR'
2018-11-25 23:42:28 [DEBUG   ] Got command RPT from MCS: ref #628175
2018-11-25 23:42:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628175  77 58447 85348989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:42:29 [DEBUG   ] Got command RPT from MCS: ref #628176
2018-11-25 23:42:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628176  12 58447 85349193 A  ERRORB˜™š'
2018-11-25 23:42:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:43:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:43:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:43:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:43:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:43:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:43:11 [DEBUG   ] Finished updating board flags in 0.968 seconds
2018-11-25 23:43:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:43:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:44:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:44:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:44:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:44:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:44:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:44:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:44:11 [DEBUG   ] Finished updating board flags in 1.295 seconds
2018-11-25 23:44:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:44:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:45:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:45:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:45:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:45:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:45:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:45:11 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-11-25 23:45:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:45:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:45:48 [DEBUG   ] Got command RPT from MCS: ref #628189
2018-11-25 23:45:48 [DEBUG   ] summary = ERROR
2018-11-25 23:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628189  13 58447 85548537 A  ERRORERROR'
2018-11-25 23:45:48 [DEBUG   ] Got command RPT from MCS: ref #628190
2018-11-25 23:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628190  77 58447 85548538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:46:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:46:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:46:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:46:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:46:11 [WARNING ] (13, 1, 'bot')
2018-11-25 23:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:46:11 [DEBUG   ] Finished updating board flags in 1.038 seconds
2018-11-25 23:46:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:46:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:47:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:47:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:47:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:47:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:47:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:47:12 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-11-25 23:47:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:47:28 [DEBUG   ] Got command RPT from MCS: ref #628206
2018-11-25 23:47:28 [DEBUG   ] summary = ERROR
2018-11-25 23:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628206  13 58447 85648461 A  ERRORERROR'
2018-11-25 23:47:28 [DEBUG   ] Got command RPT from MCS: ref #628207
2018-11-25 23:47:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628207  77 58447 85648665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:47:28 [DEBUG   ] Got command RPT from MCS: ref #628208
2018-11-25 23:47:28 [DEBUG   ] summary = ERROR
2018-11-25 23:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628208  13 58447 85648869 A  ERRORERROR'
2018-11-25 23:47:29 [DEBUG   ] Got command RPT from MCS: ref #628209
2018-11-25 23:47:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628209  77 58447 85649061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:47:29 [DEBUG   ] Got command RPT from MCS: ref #628210
2018-11-25 23:47:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628210  12 58447 85649265 A  ERRORB—™š'
2018-11-25 23:47:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:48:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:48:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:48:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:48:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:48:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:48:12 [DEBUG   ] Finished updating board flags in 1.325 seconds
2018-11-25 23:48:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:48:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:49:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:49:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:49:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:49:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:49:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:49:12 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-25 23:49:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:49:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:50:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:50:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:50:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:50:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:50:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:50:12 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-11-25 23:50:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:50:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-25 23:50:48 [DEBUG   ] Got command RPT from MCS: ref #628215
2018-11-25 23:50:48 [DEBUG   ] summary = ERROR
2018-11-25 23:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628215  13 58447 85848533 A  ERRORERROR'
2018-11-25 23:50:48 [DEBUG   ] Got command RPT from MCS: ref #628216
2018-11-25 23:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628216  77 58447 85848534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:51:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:51:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-25 23:51:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:51:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:51:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:51:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:51:12 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-25 23:51:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:51:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:52:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 23:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:52:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:52:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:52:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:52:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:52:12 [DEBUG   ] Finished updating board flags in 1.041 seconds
2018-11-25 23:52:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:52:28 [DEBUG   ] Got command RPT from MCS: ref #628238
2018-11-25 23:52:28 [DEBUG   ] summary = ERROR
2018-11-25 23:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628238  13 58447 85948541 A  ERRORERROR'
2018-11-25 23:52:28 [DEBUG   ] Got command RPT from MCS: ref #628239
2018-11-25 23:52:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628239  77 58447 85948745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:52:28 [DEBUG   ] Got command RPT from MCS: ref #628240
2018-11-25 23:52:28 [DEBUG   ] summary = ERROR
2018-11-25 23:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628240  13 58447 85948949 A  ERRORERROR'
2018-11-25 23:52:29 [DEBUG   ] Got command RPT from MCS: ref #628242
2018-11-25 23:52:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628242  77 58447 85949141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:52:29 [DEBUG   ] Got command RPT from MCS: ref #628243
2018-11-25 23:52:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628243  12 58447 85949345 A  ERRORB™™š'
2018-11-25 23:52:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:53:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:53:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-25 23:53:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:53:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:53:13 [WARNING ] (13, 1, 'bot')
2018-11-25 23:53:13 [WARNING ] (13, 1, 'bot')
2018-11-25 23:53:13 [WARNING ] (13, 1, 'bot')
2018-11-25 23:53:13 [WARNING ] (13, 1, 'bot')
2018-11-25 23:53:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:53:13 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-11-25 23:53:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:53:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:54:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:54:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:54:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:54:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:54:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:54:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:54:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:54:12 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-25 23:54:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:54:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:55:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:55:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:55:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:55:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:55:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:55:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:55:12 [DEBUG   ] Finished updating board flags in 1.228 seconds
2018-11-25 23:55:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:55:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:55:48 [DEBUG   ] Got command RPT from MCS: ref #628252
2018-11-25 23:55:48 [DEBUG   ] summary = ERROR
2018-11-25 23:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628252  13 58447 86148541 A  ERRORERROR'
2018-11-25 23:55:48 [DEBUG   ] Got command RPT from MCS: ref #628253
2018-11-25 23:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628253  77 58447 86148542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:56:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:56:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-25 23:56:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:56:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:56:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:56:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:56:12 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-11-25 23:56:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:56:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:57:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:57:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:57:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:57:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:57:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:57:12 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-25 23:57:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:57:28 [DEBUG   ] Got command RPT from MCS: ref #628269
2018-11-25 23:57:28 [DEBUG   ] summary = ERROR
2018-11-25 23:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628269  13 58447 86248621 A  ERRORERROR'
2018-11-25 23:57:28 [DEBUG   ] Got command RPT from MCS: ref #628270
2018-11-25 23:57:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628270  77 58447 86248825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:57:29 [DEBUG   ] Got command RPT from MCS: ref #628271
2018-11-25 23:57:29 [DEBUG   ] summary = ERROR
2018-11-25 23:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628271  13 58447 86249017 A  ERRORERROR'
2018-11-25 23:57:29 [DEBUG   ] Got command RPT from MCS: ref #628272
2018-11-25 23:57:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-25 23:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628272  77 58447 86249221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-25 23:57:29 [DEBUG   ] Got command RPT from MCS: ref #628273
2018-11-25 23:57:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-25 23:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628273  12 58447 86249425 A  ERRORB™™š'
2018-11-25 23:57:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:58:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:58:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:58:13 [WARNING ] (13, 1, 'bot')
2018-11-25 23:58:13 [WARNING ] (13, 1, 'bot')
2018-11-25 23:58:13 [WARNING ] (13, 1, 'bot')
2018-11-25 23:58:13 [WARNING ] (13, 1, 'bot')
2018-11-25 23:58:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:58:13 [DEBUG   ] Finished updating board flags in 1.745 seconds
2018-11-25 23:58:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:58:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-25 23:59:04 [DEBUG   ] Finished updating ant stats in 1.178 seconds
2018-11-25 23:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-25 23:59:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-25 23:59:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:59:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:59:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:59:12 [WARNING ] (13, 1, 'bot')
2018-11-25 23:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-25 23:59:12 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-25 23:59:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-25 23:59:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:00:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:00:12 [WARNING ] (13, 1, 'bot')
2018-11-26 00:00:12 [WARNING ] (13, 1, 'bot')
2018-11-26 00:00:12 [WARNING ] (13, 1, 'bot')
2018-11-26 00:00:12 [WARNING ] (13, 1, 'bot')
2018-11-26 00:00:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:00:12 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-11-26 00:00:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 00:00:44 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 00:00:48 [DEBUG   ] Got command RPT from MCS: ref #628282
2018-11-26 00:00:48 [DEBUG   ] summary = ERROR
2018-11-26 00:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628282  13 58448    48545 A  ERRORERROR'
2018-11-26 00:00:48 [DEBUG   ] Got command RPT from MCS: ref #628283
2018-11-26 00:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628283  77 58448    48546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:01:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:01:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:01:12 [WARNING ] (13, 1, 'bot')
2018-11-26 00:01:12 [WARNING ] (13, 1, 'bot')
2018-11-26 00:01:12 [WARNING ] (13, 1, 'bot')
2018-11-26 00:01:12 [WARNING ] (13, 1, 'bot')
2018-11-26 00:01:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:01:12 [DEBUG   ] Finished updating board flags in 0.963 seconds
2018-11-26 00:01:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:01:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:02:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:02:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:02:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:02:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:02:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:02:13 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-26 00:02:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:02:28 [DEBUG   ] Got command RPT from MCS: ref #628301
2018-11-26 00:02:28 [DEBUG   ] summary = ERROR
2018-11-26 00:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628301  13 58448   148697 A  ERRORERROR'
2018-11-26 00:02:28 [DEBUG   ] Got command RPT from MCS: ref #628302
2018-11-26 00:02:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628302  77 58448   148901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:02:29 [DEBUG   ] Got command RPT from MCS: ref #628303
2018-11-26 00:02:29 [DEBUG   ] summary = ERROR
2018-11-26 00:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628303  13 58448   149105 A  ERRORERROR'
2018-11-26 00:02:29 [DEBUG   ] Got command RPT from MCS: ref #628304
2018-11-26 00:02:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628304  77 58448   149309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:02:29 [DEBUG   ] Got command RPT from MCS: ref #628306
2018-11-26 00:02:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628306  12 58448   149501 A  ERRORB˜™š'
2018-11-26 00:02:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:03:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:03:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:03:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:03:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:03:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:03:13 [DEBUG   ] Finished updating board flags in 1.338 seconds
2018-11-26 00:03:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 00:03:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:04:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:04:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:04:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:04:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:04:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:04:13 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-11-26 00:04:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:04:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:05:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:05:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:05:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:05:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:05:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:05:13 [DEBUG   ] Finished updating board flags in 1.230 seconds
2018-11-26 00:05:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:05:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:05:48 [DEBUG   ] Got command RPT from MCS: ref #628315
2018-11-26 00:05:48 [DEBUG   ] summary = ERROR
2018-11-26 00:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628315  13 58448   348537 A  ERRORERROR'
2018-11-26 00:05:48 [DEBUG   ] Got command RPT from MCS: ref #628316
2018-11-26 00:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628316  77 58448   348538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:06:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:06:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:06:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:06:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:06:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:06:13 [DEBUG   ] Finished updating board flags in 1.170 seconds
2018-11-26 00:06:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:06:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:07:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:07:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:07:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:07:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:07:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:07:13 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-26 00:07:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:07:28 [DEBUG   ] Got command RPT from MCS: ref #628336
2018-11-26 00:07:28 [DEBUG   ] summary = ERROR
2018-11-26 00:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628336  13 58448   448781 A  ERRORERROR'
2018-11-26 00:07:28 [DEBUG   ] Got command RPT from MCS: ref #628337
2018-11-26 00:07:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628337  77 58448   448985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:07:29 [DEBUG   ] Got command RPT from MCS: ref #628338
2018-11-26 00:07:29 [DEBUG   ] summary = ERROR
2018-11-26 00:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628338  13 58448   449189 A  ERRORERROR'
2018-11-26 00:07:29 [DEBUG   ] Got command RPT from MCS: ref #628339
2018-11-26 00:07:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628339  77 58448   449381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:07:29 [DEBUG   ] Got command RPT from MCS: ref #628340
2018-11-26 00:07:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628340  12 58448   449585 A  ERRORB—™š'
2018-11-26 00:07:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:08:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:08:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:08:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:08:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:08:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:08:13 [DEBUG   ] Finished updating board flags in 1.045 seconds
2018-11-26 00:08:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:08:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:09:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:09:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:09:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:09:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:09:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:09:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:09:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:09:14 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-11-26 00:09:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:09:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:10:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:10:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:10:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:10:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:10:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:10:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:10:13 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-26 00:10:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-26 00:10:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 00:10:48 [DEBUG   ] Got command RPT from MCS: ref #628345
2018-11-26 00:10:48 [DEBUG   ] summary = ERROR
2018-11-26 00:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628345  13 58448   648545 A  ERRORERROR'
2018-11-26 00:10:48 [DEBUG   ] Got command RPT from MCS: ref #628346
2018-11-26 00:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628346  77 58448   648546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:11:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:11:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:11:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:11:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:11:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:11:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:11:13 [DEBUG   ] Finished updating board flags in 1.222 seconds
2018-11-26 00:11:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:11:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:12:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 00:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 00:12:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:12:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:12:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:12:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:12:13 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-11-26 00:12:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:12:28 [DEBUG   ] Got command RPT from MCS: ref #628364
2018-11-26 00:12:28 [DEBUG   ] summary = ERROR
2018-11-26 00:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628364  13 58448   748865 A  ERRORERROR'
2018-11-26 00:12:29 [DEBUG   ] Got command RPT from MCS: ref #628365
2018-11-26 00:12:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628365  77 58448   749069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:12:29 [DEBUG   ] Got command RPT from MCS: ref #628366
2018-11-26 00:12:29 [DEBUG   ] summary = ERROR
2018-11-26 00:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628366  13 58448   749261 A  ERRORERROR'
2018-11-26 00:12:29 [DEBUG   ] Got command RPT from MCS: ref #628368
2018-11-26 00:12:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628368  77 58448   749465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:12:29 [DEBUG   ] Got command RPT from MCS: ref #628369
2018-11-26 00:12:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628369  12 58448   749669 A  ERRORB™™š'
2018-11-26 00:12:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:13:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 00:13:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:13:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:13:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:13:13 [WARNING ] (13, 1, 'bot')
2018-11-26 00:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:13:13 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-11-26 00:13:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:13:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:14:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:14:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:14:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:14:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:14:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:14:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:14:14 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-11-26 00:14:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:14:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:15:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 00:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:15:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:15:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:15:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:15:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:15:14 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-26 00:15:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:15:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:15:48 [DEBUG   ] Got command RPT from MCS: ref #628382
2018-11-26 00:15:48 [DEBUG   ] summary = ERROR
2018-11-26 00:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628382  13 58448   948541 A  ERRORERROR'
2018-11-26 00:15:48 [DEBUG   ] Got command RPT from MCS: ref #628383
2018-11-26 00:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628383  77 58448   948542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:16:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:16:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:16:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:16:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:16:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:16:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:16:14 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-11-26 00:16:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:16:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:17:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:17:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:17:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:17:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:17:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:17:14 [DEBUG   ] Finished updating board flags in 1.253 seconds
2018-11-26 00:17:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 00:17:28 [DEBUG   ] Got command RPT from MCS: ref #628399
2018-11-26 00:17:28 [DEBUG   ] summary = ERROR
2018-11-26 00:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628399  13 58448  1048949 A  ERRORERROR'
2018-11-26 00:17:29 [DEBUG   ] Got command RPT from MCS: ref #628400
2018-11-26 00:17:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628400  77 58448  1049153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:17:29 [DEBUG   ] Got command RPT from MCS: ref #628401
2018-11-26 00:17:29 [DEBUG   ] summary = ERROR
2018-11-26 00:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628401  13 58448  1049345 A  ERRORERROR'
2018-11-26 00:17:29 [DEBUG   ] Got command RPT from MCS: ref #628402
2018-11-26 00:17:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628402  77 58448  1049549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:17:29 [DEBUG   ] Got command RPT from MCS: ref #628403
2018-11-26 00:17:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628403  12 58448  1049753 A  ERRORB˜™š'
2018-11-26 00:17:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:18:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:18:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:18:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:18:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:18:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:18:14 [DEBUG   ] Finished updating board flags in 1.126 seconds
2018-11-26 00:18:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:18:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:19:00 [DEBUG   ] Got command RPT from MCS: ref #628409
2018-11-26 00:19:00 [DEBUG   ] summary = ERROR
2018-11-26 00:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628409  13 58448  1140397 A  ERRORERROR'
2018-11-26 00:19:00 [DEBUG   ] Got command RPT from MCS: ref #628410
2018-11-26 00:19:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628410  77 58448  1140398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:19:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:19:05 [DEBUG   ] Got command INI from MCS: ref #628414
2018-11-26 00:19:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-26 00:19:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   628414   8 58448  1145406 ABOOTING'
2018-11-26 00:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:19:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:19:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:19:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:19:14 [WARNING ] (13, 1, 'bot')
2018-11-26 00:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:19:14 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-26 00:19:25 [INFO    ] -------------------
2018-11-26 00:19:25 [INFO    ]  LWA board status
2018-11-26 00:19:25 [INFO    ] -------------------
2018-11-26 00:19:25 [INFO    ] DP 1: 2 lwa27
2018-11-26 00:19:25 [INFO    ] DP 1: 3 lwa24
2018-11-26 00:19:25 [INFO    ] DP 1: 4 lwa23
2018-11-26 00:19:25 [INFO    ] DP 1: 5 lwa18
2018-11-26 00:19:25 [INFO    ] DP 1: 6 lwa10
2018-11-26 00:19:25 [INFO    ] DP 1: 7 lwa32
2018-11-26 00:19:25 [INFO    ] DP 1: 8 lwa11
2018-11-26 00:19:25 [INFO    ] DP 1: 9 lwa30
2018-11-26 00:19:25 [INFO    ] DP 1: 10 lwa12
2018-11-26 00:19:25 [INFO    ] DP 1: 11 lwa8
2018-11-26 00:19:25 [INFO    ] DP 1: 12 lwa13
2018-11-26 00:19:25 [INFO    ] DP 1: 13 lwa26
2018-11-26 00:19:25 [INFO    ] DP 1: 14 lwa14
2018-11-26 00:19:25 [INFO    ] DP 1: 16 lwa22
2018-11-26 00:19:25 [INFO    ] DP 1: 17 lwa20
2018-11-26 00:19:25 [INFO    ] DP 1: 18 lwa1
2018-11-26 00:19:25 [INFO    ] DP 1: 19 lwa5
2018-11-26 00:19:25 [INFO    ] DP 1: 20 lwa25
2018-11-26 00:19:25 [INFO    ] DP 1: 21 lwa35
2018-11-26 00:19:25 [INFO    ] DP 1: 22 lwa19
2018-11-26 00:19:25 [INFO    ] DP 1: 23 lwa21
2018-11-26 00:19:25 [INFO    ] DP 1: 24 lwa6
2018-11-26 00:19:25 [INFO    ] DP 1: 25 lwa7
2018-11-26 00:19:25 [INFO    ] DP 1: 26 lwa33
2018-11-26 00:19:25 [INFO    ] DP 1: 27 lwa15
2018-11-26 00:19:25 [INFO    ] DP 1: 28 lwa28
2018-11-26 00:19:25 [INFO    ] DP 2: 1 lwa16
2018-11-26 00:19:25 [INFO    ] DP 2: 15 lwa34
2018-11-26 00:19:25 [INFO    ] Total of 28 boards
2018-11-26 00:19:25 [INFO    ] Total of 260 stands
2018-11-26 00:19:25 [INFO    ] -------------------
2018-11-26 00:19:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13632
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13633
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13634
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13635
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13636
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13637
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13638
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13639
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13640
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13641
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13642
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13643
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13644
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13645
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13646
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13647
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13648
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13649
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13650
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13651
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13652
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13653
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13654
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13655
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13656
2018-11-26 00:19:32 [DEBUG   ] 2018-11-26 00:19:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13657
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13632 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13633 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13634 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13635 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13636 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13637 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13638 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13639 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13640 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13641 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13642 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13643 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13644 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13645 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13646 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13647 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13648 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13649 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13650 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13651 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13652 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13653 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13654 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13655 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13656 exited with status 0
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13657 exited with status 0
2018-11-26 00:19:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] spawn_process: at 2018-11-26 00:19:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13684
2018-11-26 00:19:44 [DEBUG   ] 2018-11-26 00:19:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13685
2018-11-26 00:19:50 [DEBUG   ] 2018-11-26 00:19:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13684 exited with status 0
2018-11-26 00:19:50 [DEBUG   ] 2018-11-26 00:19:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13685 exited with status 0
2018-11-26 00:19:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-26 00:19:50 [DEBUG   ] spawn_process: at 2018-11-26 00:19:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-26 00:19:50 [DEBUG   ] spawn_process: at 2018-11-26 00:19:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-26 00:19:50 [INFO    ] Setting Beam 1 xbars
2018-11-26 00:19:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-26 00:19:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-26 00:19:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-26 00:19:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-26 00:19:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-26 00:19:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-26 00:19:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-26 00:19:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-26 00:19:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-26 00:19:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-26 00:19:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-26 00:19:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-26 00:19:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-26 00:19:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-26 00:19:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-26 00:19:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-26 00:19:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-26 00:19:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-26 00:19:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-26 00:19:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-26 00:19:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-26 00:19:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-26 00:19:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-26 00:19:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-26 00:19:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-26 00:19:55 [INFO    ] Setting Beam 2 xbars
2018-11-26 00:19:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-26 00:19:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-26 00:19:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-26 00:19:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-26 00:19:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-26 00:20:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-26 00:20:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-26 00:20:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-26 00:20:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-26 00:20:01 [INFO    ] Setting Beam 3 xbars
2018-11-26 00:20:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-26 00:20:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-26 00:20:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-26 00:20:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-26 00:20:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-26 00:20:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-26 00:20:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-26 00:20:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-26 00:20:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-26 00:20:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-26 00:20:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-26 00:20:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-26 00:20:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-26 00:20:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-26 00:20:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-26 00:20:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-26 00:20:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-26 00:20:06 [INFO    ] Setting Beam 4 xbars
2018-11-26 00:20:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-26 00:20:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-26 00:20:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-26 00:20:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-26 00:20:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-26 00:20:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-26 00:20:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-26 00:20:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-26 00:20:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-26 00:20:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-26 00:20:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-26 00:20:12 [INFO    ] All xbars set
2018-11-26 00:20:12 [INFO    ] Setting adder chain routing for all beams
2018-11-26 00:20:17 [INFO    ] Setting beam ids
2018-11-26 00:20:27 [INFO    ] Starting beam delay calibration
2018-11-26 00:20:39 [INFO    ] Beam 1 latency is 5712
2018-11-26 00:20:39 [INFO    ] Beam 2 latency is 5747
2018-11-26 00:20:39 [INFO    ] Beam 3 latency is 5726
2018-11-26 00:20:39 [INFO    ] Beam 4 latency is 5721
2018-11-26 00:20:39 [INFO    ] Stop calibration
2018-11-26 00:20:47 [INFO    ] Beam delay calibration successful
2018-11-26 00:20:47 [INFO    ] Calibration passed
2018-11-26 00:20:47 [DEBUG   ] spawn_process: at 2018-11-26 00:20:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-26 00:20:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-26 00:20:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-26 00:20:47 [DEBUG   ] spawn_process: at 2018-11-26 00:20:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-26 00:20:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-26 00:20:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-26 00:20:47 [DEBUG   ] spawn_process: at 2018-11-26 00:20:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-26 00:20:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-26 00:20:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-26 00:20:47 [DEBUG   ] spawn_process: at 2018-11-26 00:20:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-26 00:20:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-26 00:20:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-26 00:20:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-26 00:20:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 536 ms (1543191647.538 s) with PID 15264 and time 1543191648
2018-11-26 00:20:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-26 00:20:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 271 ms (1543191648.273 s) with PID 15285 and time 1543191649
2018-11-26 00:20:48 [DEBUG   ] Got command RPT from MCS: ref #628416
2018-11-26 00:20:48 [DEBUG   ] summary = ERROR
2018-11-26 00:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628416  13 58448  1248545 A  ERRORERROR'
2018-11-26 00:20:48 [DEBUG   ] Got command RPT from MCS: ref #628417
2018-11-26 00:20:48 [DEBUG   ] info = Calibration passed
2018-11-26 00:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628417  26 58448  1248546 A  ERRORCalibration passed'
2018-11-26 00:20:49 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-26 00:20:49 [INFO    ] Started antennas statistics background thread
2018-11-26 00:20:49 [INFO    ] Started board flags background thread
2018-11-26 00:20:49 [INFO    ] Started BAM background thread
2018-11-26 00:20:49 [INFO    ] Finished the INI process (ref. #628414) in 103.989 s
2018-11-26 00:20:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:20:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:20:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:20:50 [WARNING ] (13, 1, 'bot')
2018-11-26 00:20:50 [WARNING ] (13, 1, 'bot')
2018-11-26 00:20:50 [WARNING ] (13, 1, 'bot')
2018-11-26 00:20:50 [WARNING ] (13, 1, 'bot')
2018-11-26 00:20:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-26 00:20:50 [DEBUG   ] Finished updating board flags in 1.160 seconds
2018-11-26 00:21:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:21:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:21:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:21:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:21:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:21:50 [WARNING ] (13, 1, 'bot')
2018-11-26 00:21:50 [WARNING ] (13, 1, 'bot')
2018-11-26 00:21:50 [WARNING ] (13, 1, 'bot')
2018-11-26 00:21:50 [WARNING ] (13, 1, 'bot')
2018-11-26 00:21:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-26 00:21:50 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-11-26 00:22:05 [DEBUG   ] Got command RPT from MCS: ref #628437
2018-11-26 00:22:05 [DEBUG   ] summary = ERROR
2018-11-26 00:22:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628437  13 58448  1325397 A  ERRORERROR'
2018-11-26 00:22:05 [DEBUG   ] Got command RPT from MCS: ref #628438
2018-11-26 00:22:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:22:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628438  98 58448  1325398 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:22:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:22:10 [DEBUG   ] Got command INI from MCS: ref #628440
2018-11-26 00:22:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-26 00:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   628440   8 58448  1330406 ABOOTING'
2018-11-26 00:22:29 [DEBUG   ] Got command RPT from MCS: ref #628442
2018-11-26 00:22:29 [DEBUG   ] summary = BOOTING
2018-11-26 00:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628442  15 58448  1349029 ABOOTINGBOOTING'
2018-11-26 00:22:30 [INFO    ] -------------------
2018-11-26 00:22:30 [INFO    ]  LWA board status
2018-11-26 00:22:30 [INFO    ] -------------------
2018-11-26 00:22:30 [INFO    ] DP 1: 2 lwa27
2018-11-26 00:22:30 [INFO    ] DP 1: 3 lwa24
2018-11-26 00:22:30 [INFO    ] DP 1: 4 lwa23
2018-11-26 00:22:30 [INFO    ] DP 1: 5 lwa18
2018-11-26 00:22:30 [INFO    ] DP 1: 6 lwa10
2018-11-26 00:22:30 [INFO    ] DP 1: 7 lwa32
2018-11-26 00:22:30 [INFO    ] DP 1: 8 lwa11
2018-11-26 00:22:30 [INFO    ] DP 1: 9 lwa30
2018-11-26 00:22:30 [INFO    ] DP 1: 10 lwa12
2018-11-26 00:22:30 [INFO    ] DP 1: 11 lwa8
2018-11-26 00:22:30 [INFO    ] DP 1: 12 lwa13
2018-11-26 00:22:30 [INFO    ] DP 1: 13 lwa26
2018-11-26 00:22:30 [INFO    ] DP 1: 14 lwa14
2018-11-26 00:22:30 [INFO    ] DP 1: 16 lwa22
2018-11-26 00:22:30 [INFO    ] DP 1: 17 lwa20
2018-11-26 00:22:30 [INFO    ] DP 1: 18 lwa1
2018-11-26 00:22:30 [INFO    ] DP 1: 19 lwa5
2018-11-26 00:22:30 [INFO    ] DP 1: 20 lwa25
2018-11-26 00:22:30 [INFO    ] DP 1: 21 lwa35
2018-11-26 00:22:30 [INFO    ] DP 1: 22 lwa19
2018-11-26 00:22:30 [INFO    ] DP 1: 23 lwa21
2018-11-26 00:22:30 [INFO    ] DP 1: 24 lwa6
2018-11-26 00:22:30 [INFO    ] DP 1: 25 lwa7
2018-11-26 00:22:30 [INFO    ] DP 1: 26 lwa33
2018-11-26 00:22:30 [INFO    ] DP 1: 27 lwa15
2018-11-26 00:22:30 [INFO    ] DP 1: 28 lwa28
2018-11-26 00:22:30 [INFO    ] DP 2: 1 lwa16
2018-11-26 00:22:30 [INFO    ] DP 2: 15 lwa34
2018-11-26 00:22:30 [INFO    ] Total of 28 boards
2018-11-26 00:22:30 [INFO    ] Total of 260 stands
2018-11-26 00:22:30 [INFO    ] -------------------
2018-11-26 00:22:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15835
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15836
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15837
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15838
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15839
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15840
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15841
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15842
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15843
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15844
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15845
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15846
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15847
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15848
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15849
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15850
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15851
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15852
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15853
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15854
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15855
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15856
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15857
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15858
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15859
2018-11-26 00:22:37 [DEBUG   ] 2018-11-26 00:22:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15860
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15835 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15836 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15837 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15838 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15839 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15840 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15841 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15842 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15843 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15844 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15845 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15846 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15847 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15848 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15849 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15850 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15851 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15852 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15853 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15854 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15855 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15856 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15857 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15858 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15859 exited with status 0
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15860 exited with status 0
2018-11-26 00:22:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] spawn_process: at 2018-11-26 00:22:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15887
2018-11-26 00:22:49 [DEBUG   ] 2018-11-26 00:22:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15888
2018-11-26 00:22:55 [DEBUG   ] 2018-11-26 00:22:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15887 exited with status 0
2018-11-26 00:22:55 [DEBUG   ] 2018-11-26 00:22:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15888 exited with status 0
2018-11-26 00:22:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-26 00:22:55 [DEBUG   ] spawn_process: at 2018-11-26 00:22:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-26 00:22:55 [DEBUG   ] spawn_process: at 2018-11-26 00:22:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-26 00:22:55 [INFO    ] Setting Beam 1 xbars
2018-11-26 00:22:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-26 00:22:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-26 00:22:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-26 00:22:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-26 00:22:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-26 00:22:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-26 00:22:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-26 00:22:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-26 00:22:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-26 00:22:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-26 00:22:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-26 00:22:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-26 00:22:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-26 00:22:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-26 00:22:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-26 00:22:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-26 00:22:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-26 00:23:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-26 00:23:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-26 00:23:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-26 00:23:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-26 00:23:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-26 00:23:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-26 00:23:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-26 00:23:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-26 00:23:00 [INFO    ] Setting Beam 2 xbars
2018-11-26 00:23:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-26 00:23:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-26 00:23:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-26 00:23:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-26 00:23:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-26 00:23:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-26 00:23:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-26 00:23:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-26 00:23:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-26 00:23:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-26 00:23:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-26 00:23:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-26 00:23:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-26 00:23:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-26 00:23:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-26 00:23:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-26 00:23:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-26 00:23:06 [INFO    ] Setting Beam 3 xbars
2018-11-26 00:23:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-26 00:23:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-26 00:23:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-26 00:23:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-26 00:23:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-26 00:23:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-26 00:23:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-26 00:23:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-26 00:23:12 [INFO    ] Setting Beam 4 xbars
2018-11-26 00:23:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-26 00:23:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-26 00:23:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-26 00:23:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-26 00:23:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-26 00:23:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-26 00:23:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-26 00:23:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-26 00:23:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-26 00:23:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-26 00:23:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-26 00:23:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-26 00:23:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-26 00:23:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-26 00:23:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-26 00:23:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-26 00:23:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-26 00:23:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-26 00:23:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-26 00:23:17 [INFO    ] All xbars set
2018-11-26 00:23:17 [INFO    ] Setting adder chain routing for all beams
2018-11-26 00:23:22 [INFO    ] Setting beam ids
2018-11-26 00:23:32 [INFO    ] Starting beam delay calibration
2018-11-26 00:23:44 [INFO    ] Beam 1 latency is 5725
2018-11-26 00:23:44 [INFO    ] Beam 2 latency is 5750
2018-11-26 00:23:44 [INFO    ] Beam 3 latency is 5743
2018-11-26 00:23:44 [INFO    ] Beam 4 latency is 5728
2018-11-26 00:23:44 [INFO    ] Stop calibration
2018-11-26 00:23:52 [INFO    ] Beam delay calibration successful
2018-11-26 00:23:52 [INFO    ] Calibration passed
2018-11-26 00:23:52 [DEBUG   ] spawn_process: at 2018-11-26 00:23:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-26 00:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-26 00:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-26 00:23:52 [DEBUG   ] spawn_process: at 2018-11-26 00:23:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-26 00:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-26 00:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-26 00:23:52 [DEBUG   ] spawn_process: at 2018-11-26 00:23:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-26 00:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-26 00:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-26 00:23:52 [DEBUG   ] spawn_process: at 2018-11-26 00:23:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-26 00:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-26 00:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-26 00:23:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-26 00:23:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 272 ms (1543191833.274 s) with PID 17462 and time 1543191834
2018-11-26 00:23:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-26 00:23:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 361 ms (1543191833.363 s) with PID 17465 and time 1543191834
2018-11-26 00:23:54 [DEBUG   ] Finished updating ant stats in 0.884 seconds
2018-11-26 00:23:54 [INFO    ] Started antennas statistics background thread
2018-11-26 00:23:54 [INFO    ] Started board flags background thread
2018-11-26 00:23:54 [INFO    ] Started BAM background thread
2018-11-26 00:23:54 [INFO    ] Finished the INI process (ref. #628440) in 104.080 s
2018-11-26 00:23:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:23:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:23:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:23:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:23:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:23:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:23:55 [DEBUG   ] Finished updating board flags in 1.065 seconds
2018-11-26 00:24:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:24:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:24:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:24:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 00:24:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:24:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:24:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:24:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:24:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:24:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:24:55 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-26 00:25:10 [DEBUG   ] Got command RPT from MCS: ref #628452
2018-11-26 00:25:10 [DEBUG   ] summary = ERROR
2018-11-26 00:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628452  13 58448  1510401 A  ERRORERROR'
2018-11-26 00:25:10 [DEBUG   ] Got command RPT from MCS: ref #628453
2018-11-26 00:25:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628453  77 58448  1510402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:25:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 00:25:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:25:48 [DEBUG   ] Got command RPT from MCS: ref #628454
2018-11-26 00:25:48 [DEBUG   ] summary = ERROR
2018-11-26 00:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628454  13 58448  1548545 A  ERRORERROR'
2018-11-26 00:25:48 [DEBUG   ] Got command RPT from MCS: ref #628455
2018-11-26 00:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628455  77 58448  1548546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:25:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:25:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:25:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:25:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:25:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:25:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:25:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:25:55 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-26 00:26:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:26:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:26:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:26:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:26:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:26:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:26:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:26:56 [DEBUG   ] Finished updating board flags in 1.887 seconds
2018-11-26 00:27:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:27:29 [DEBUG   ] Got command RPT from MCS: ref #628471
2018-11-26 00:27:29 [DEBUG   ] summary = ERROR
2018-11-26 00:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628471  13 58448  1649113 A  ERRORERROR'
2018-11-26 00:27:29 [DEBUG   ] Got command RPT from MCS: ref #628472
2018-11-26 00:27:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628472  77 58448  1649317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:27:29 [DEBUG   ] Got command RPT from MCS: ref #628473
2018-11-26 00:27:29 [DEBUG   ] summary = ERROR
2018-11-26 00:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628473  13 58448  1649521 A  ERRORERROR'
2018-11-26 00:27:29 [DEBUG   ] Got command RPT from MCS: ref #628474
2018-11-26 00:27:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628474  77 58448  1649713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:27:29 [DEBUG   ] Got command RPT from MCS: ref #628475
2018-11-26 00:27:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628475  12 58448  1649917 A  ERRORB˜™š'
2018-11-26 00:27:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:27:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:27:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:27:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:27:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:27:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:27:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:27:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:27:56 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-26 00:28:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:28:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:28:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:28:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:28:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:28:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:28:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:28:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:28:55 [DEBUG   ] Finished updating board flags in 1.145 seconds
2018-11-26 00:29:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:29:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:29:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:29:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:29:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:29:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:29:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:29:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:29:55 [DEBUG   ] Finished updating board flags in 1.032 seconds
2018-11-26 00:30:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:30:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:30:48 [DEBUG   ] Got command RPT from MCS: ref #628484
2018-11-26 00:30:48 [DEBUG   ] summary = ERROR
2018-11-26 00:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628484  13 58448  1848549 A  ERRORERROR'
2018-11-26 00:30:48 [DEBUG   ] Got command RPT from MCS: ref #628485
2018-11-26 00:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628485  77 58448  1848550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:30:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:30:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:30:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:30:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:30:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:30:55 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-26 00:31:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:31:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:31:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 00:31:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:31:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:31:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:31:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:31:55 [WARNING ] (13, 1, 'bot')
2018-11-26 00:31:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:31:55 [DEBUG   ] Finished updating board flags in 0.963 seconds
2018-11-26 00:32:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:32:29 [DEBUG   ] Got command RPT from MCS: ref #628503
2018-11-26 00:32:29 [DEBUG   ] summary = ERROR
2018-11-26 00:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628503  13 58448  1949201 A  ERRORERROR'
2018-11-26 00:32:29 [DEBUG   ] Got command RPT from MCS: ref #628504
2018-11-26 00:32:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628504  77 58448  1949405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:32:29 [DEBUG   ] Got command RPT from MCS: ref #628505
2018-11-26 00:32:29 [DEBUG   ] summary = ERROR
2018-11-26 00:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628505  13 58448  1949597 A  ERRORERROR'
2018-11-26 00:32:29 [DEBUG   ] Got command RPT from MCS: ref #628507
2018-11-26 00:32:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628507  77 58448  1949801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:32:30 [DEBUG   ] Got command RPT from MCS: ref #628509
2018-11-26 00:32:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628509  12 58448  1950005 A  ERRORB˜™š'
2018-11-26 00:32:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:32:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 00:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:32:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:32:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:32:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:32:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:32:56 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-26 00:33:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 00:33:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:33:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:33:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:33:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:33:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:33:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:33:56 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-26 00:34:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:34:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:34:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:34:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:34:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:34:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:34:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:34:56 [DEBUG   ] Finished updating board flags in 1.245 seconds
2018-11-26 00:35:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:35:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:35:48 [DEBUG   ] Got command RPT from MCS: ref #628517
2018-11-26 00:35:48 [DEBUG   ] summary = ERROR
2018-11-26 00:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628517  13 58448  2148545 A  ERRORERROR'
2018-11-26 00:35:48 [DEBUG   ] Got command RPT from MCS: ref #628518
2018-11-26 00:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628518  77 58448  2148546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:35:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:35:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:35:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:35:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:35:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:35:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:35:56 [DEBUG   ] Finished updating board flags in 1.223 seconds
2018-11-26 00:36:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:36:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:36:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:36:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:36:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:36:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:36:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:36:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:36:56 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-11-26 00:37:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:37:29 [DEBUG   ] Got command RPT from MCS: ref #628538
2018-11-26 00:37:29 [DEBUG   ] summary = ERROR
2018-11-26 00:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628538  13 58448  2249289 A  ERRORERROR'
2018-11-26 00:37:29 [DEBUG   ] Got command RPT from MCS: ref #628539
2018-11-26 00:37:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628539  77 58448  2249493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:37:29 [DEBUG   ] Got command RPT from MCS: ref #628540
2018-11-26 00:37:29 [DEBUG   ] summary = ERROR
2018-11-26 00:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628540  13 58448  2249685 A  ERRORERROR'
2018-11-26 00:37:29 [DEBUG   ] Got command RPT from MCS: ref #628541
2018-11-26 00:37:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628541  77 58448  2249889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:37:30 [DEBUG   ] Got command RPT from MCS: ref #628542
2018-11-26 00:37:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628542  12 58448  2250093 A  ERRORB˜™š'
2018-11-26 00:37:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:37:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:37:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:37:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:37:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:37:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:37:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:37:56 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-11-26 00:38:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:38:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:38:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:38:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:38:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:38:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:38:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:38:56 [DEBUG   ] Finished updating board flags in 1.064 seconds
2018-11-26 00:39:14 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-26 00:39:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:39:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:39:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:39:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:39:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:39:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:39:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:39:57 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-11-26 00:40:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:40:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-26 00:40:48 [DEBUG   ] Got command RPT from MCS: ref #628547
2018-11-26 00:40:48 [DEBUG   ] summary = ERROR
2018-11-26 00:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628547  13 58448  2448545 A  ERRORERROR'
2018-11-26 00:40:48 [DEBUG   ] Got command RPT from MCS: ref #628548
2018-11-26 00:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628548  77 58448  2448546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:40:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:40:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:40:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:40:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:40:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:40:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:40:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:40:57 [DEBUG   ] Finished updating board flags in 1.928 seconds
2018-11-26 00:41:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:41:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:41:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:41:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:41:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:41:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:41:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:41:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:41:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:41:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:41:56 [DEBUG   ] Finished updating board flags in 1.251 seconds
2018-11-26 00:42:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:42:29 [DEBUG   ] Got command RPT from MCS: ref #628566
2018-11-26 00:42:29 [DEBUG   ] summary = ERROR
2018-11-26 00:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628566  13 58448  2549373 A  ERRORERROR'
2018-11-26 00:42:29 [DEBUG   ] Got command RPT from MCS: ref #628567
2018-11-26 00:42:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628567  77 58448  2549577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:42:29 [DEBUG   ] Got command RPT from MCS: ref #628568
2018-11-26 00:42:29 [DEBUG   ] summary = ERROR
2018-11-26 00:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628568  13 58448  2549769 A  ERRORERROR'
2018-11-26 00:42:29 [DEBUG   ] Got command RPT from MCS: ref #628570
2018-11-26 00:42:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628570  77 58448  2549973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:42:30 [DEBUG   ] Got command RPT from MCS: ref #628571
2018-11-26 00:42:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628571  12 58448  2550177 A  ERRORB˜™š'
2018-11-26 00:42:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:42:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 00:42:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:42:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:42:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:42:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:42:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:42:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:42:56 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-11-26 00:43:05 [DEBUG   ] Got command DRX from MCS: ref #628584
2018-11-26 00:43:05 [INFO    ] sending drx command to lwa34
2018-11-26 00:43:05 [DEBUG   ] run_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 58000000.0 7 13 7']
2018-11-26 00:43:05 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-26 00:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   628584   8 58448  2585009 A  ERROR'
2018-11-26 00:43:05 [DEBUG   ] Got command DRX from MCS: ref #628585
2018-11-26 00:43:05 [INFO    ] sending drx command to lwa16
2018-11-26 00:43:05 [DEBUG   ] run_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 58000000.0 7 13 7']
2018-11-26 00:43:05 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-26 00:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   628585   8 58448  2585013 A  ERROR'
2018-11-26 00:43:05 [DEBUG   ] Got command DRX from MCS: ref #628586
2018-11-26 00:43:05 [INFO    ] sending drx command to lwa34
2018-11-26 00:43:05 [DEBUG   ] run_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 74000000.0 7 13 7']
2018-11-26 00:43:05 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-26 00:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   628586   8 58448  2585017 A  ERROR'
2018-11-26 00:43:05 [DEBUG   ] Got command DRX from MCS: ref #628587
2018-11-26 00:43:05 [INFO    ] sending drx command to lwa16
2018-11-26 00:43:05 [DEBUG   ] run_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74000000.0 7 13 7']
2018-11-26 00:43:05 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-26 00:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   628587   8 58448  2585021 A  ERROR'
2018-11-26 00:43:05 [DEBUG   ] Got command BAM from MCS: ref #628589
2018-11-26 00:43:05 [INFO    ] Finished processing BAM request
2018-11-26 00:43:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-26 00:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   628589   8 58448  2585025 A  ERROR'
2018-11-26 00:43:05 [DEBUG   ] Got command BAM from MCS: ref #628588
2018-11-26 00:43:05 [INFO    ] Finished processing BAM request
2018-11-26 00:43:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-26 00:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   628588   8 58448  2585029 A  ERROR'
2018-11-26 00:43:05 [INFO    ] Finished starting DRX
2018-11-26 00:43:05 [INFO    ] Finished starting DRX
2018-11-26 00:43:05 [INFO    ] Finished starting DRX
2018-11-26 00:43:05 [INFO    ] Finished starting DRX
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-26 00:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-26 00:43:05 [DEBUG   ] spawn_process: at 2018-11-26 00:43:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-26 00:43:14 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-26 00:43:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:43:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:43:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:43:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:43:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:43:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:43:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:43:56 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-26 00:44:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:44:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:44:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:44:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 00:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:44:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:44:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:44:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:44:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:44:56 [DEBUG   ] Finished updating board flags in 1.166 seconds
2018-11-26 00:45:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:45:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:45:48 [DEBUG   ] Got command RPT from MCS: ref #628596
2018-11-26 00:45:48 [DEBUG   ] summary = ERROR
2018-11-26 00:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628596  13 58448  2748545 A  ERRORERROR'
2018-11-26 00:45:48 [DEBUG   ] Got command RPT from MCS: ref #628597
2018-11-26 00:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628597  77 58448  2748546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:45:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:45:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 00:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:45:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-26 00:45:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:45:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:45:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:45:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:45:56 [DEBUG   ] Finished updating board flags in 1.088 seconds
2018-11-26 00:46:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:46:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:46:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:46:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:46:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 00:46:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:46:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:46:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:46:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:46:56 [WARNING ] (13, 1, 'bot')
2018-11-26 00:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:46:56 [DEBUG   ] Finished updating board flags in 0.922 seconds
2018-11-26 00:47:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 00:47:29 [DEBUG   ] Got command RPT from MCS: ref #628613
2018-11-26 00:47:29 [DEBUG   ] summary = ERROR
2018-11-26 00:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628613  13 58448  2849465 A  ERRORERROR'
2018-11-26 00:47:29 [DEBUG   ] Got command RPT from MCS: ref #628614
2018-11-26 00:47:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628614  77 58448  2849657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:47:29 [DEBUG   ] Got command RPT from MCS: ref #628615
2018-11-26 00:47:29 [DEBUG   ] summary = ERROR
2018-11-26 00:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628615  13 58448  2849861 A  ERRORERROR'
2018-11-26 00:47:30 [DEBUG   ] Got command RPT from MCS: ref #628616
2018-11-26 00:47:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628616  77 58448  2850065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:47:30 [DEBUG   ] Got command RPT from MCS: ref #628617
2018-11-26 00:47:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628617  12 58448  2850269 A  ERRORB ff'
2018-11-26 00:47:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:47:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:47:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:47:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 00:47:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2018-11-26 00:47:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:47:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:47:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:47:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:47:57 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-11-26 00:48:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:48:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:48:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 00:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-26 00:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-26 00:48:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:48:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:48:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:48:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:48:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:48:57 [DEBUG   ] Finished updating board flags in 1.178 seconds
2018-11-26 00:49:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 00:49:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:49:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-26 00:49:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 00:49:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:49:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:49:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:49:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:49:57 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-26 00:50:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:50:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:50:48 [DEBUG   ] Got command RPT from MCS: ref #628622
2018-11-26 00:50:48 [DEBUG   ] summary = ERROR
2018-11-26 00:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628622  13 58448  3048549 A  ERRORERROR'
2018-11-26 00:50:48 [DEBUG   ] Got command RPT from MCS: ref #628623
2018-11-26 00:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628623  77 58448  3048550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:50:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:50:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 00:50:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 00:50:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:50:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:50:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:50:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:50:57 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-11-26 00:51:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:51:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:51:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:51:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 00:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:51:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 00:51:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:51:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:51:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:51:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:51:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:51:58 [DEBUG   ] Finished updating board flags in 1.858 seconds
2018-11-26 00:52:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:52:29 [DEBUG   ] Got command RPT from MCS: ref #628645
2018-11-26 00:52:29 [DEBUG   ] summary = ERROR
2018-11-26 00:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628645  13 58448  3149541 A  ERRORERROR'
2018-11-26 00:52:29 [DEBUG   ] Got command RPT from MCS: ref #628646
2018-11-26 00:52:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628646  77 58448  3149745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:52:29 [DEBUG   ] Got command RPT from MCS: ref #628647
2018-11-26 00:52:29 [DEBUG   ] summary = ERROR
2018-11-26 00:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628647  13 58448  3149949 A  ERRORERROR'
2018-11-26 00:52:30 [DEBUG   ] Got command RPT from MCS: ref #628649
2018-11-26 00:52:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628649  77 58448  3150153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:52:30 [DEBUG   ] Got command RPT from MCS: ref #628650
2018-11-26 00:52:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628650  12 58448  3150345 A  ERRORB¢ff'
2018-11-26 00:52:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:52:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:52:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-26 00:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:52:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:52:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:52:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:52:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:52:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:52:58 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-26 00:53:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:53:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:53:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 00:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 00:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 00:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-26 00:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:53:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 00:53:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:53:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:53:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:53:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:53:57 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-11-26 00:54:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:54:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:54:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-26 00:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-26 00:54:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 00:54:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:54:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:54:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:54:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:54:57 [DEBUG   ] Finished updating board flags in 1.060 seconds
2018-11-26 00:55:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:55:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:55:48 [DEBUG   ] Got command RPT from MCS: ref #628659
2018-11-26 00:55:48 [DEBUG   ] summary = ERROR
2018-11-26 00:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628659  13 58448  3348557 A  ERRORERROR'
2018-11-26 00:55:48 [DEBUG   ] Got command RPT from MCS: ref #628660
2018-11-26 00:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628660  77 58448  3348558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:55:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:55:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:55:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:55:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:55:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:55:57 [WARNING ] (13, 1, 'bot')
2018-11-26 00:55:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:55:57 [DEBUG   ] Finished updating board flags in 0.942 seconds
2018-11-26 00:56:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:56:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:56:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:56:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-26 00:56:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:56:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:56:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:56:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:56:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:56:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:56:58 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-26 00:57:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:57:29 [DEBUG   ] Got command RPT from MCS: ref #628676
2018-11-26 00:57:29 [DEBUG   ] summary = ERROR
2018-11-26 00:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628676  13 58448  3449633 A  ERRORERROR'
2018-11-26 00:57:29 [DEBUG   ] Got command RPT from MCS: ref #628677
2018-11-26 00:57:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628677  77 58448  3449825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:57:30 [DEBUG   ] Got command RPT from MCS: ref #628678
2018-11-26 00:57:30 [DEBUG   ] summary = ERROR
2018-11-26 00:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628678  13 58448  3450029 A  ERRORERROR'
2018-11-26 00:57:30 [DEBUG   ] Got command RPT from MCS: ref #628679
2018-11-26 00:57:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 00:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628679  77 58448  3450233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 00:57:30 [DEBUG   ] Got command RPT from MCS: ref #628680
2018-11-26 00:57:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 00:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628680  12 58448  3450437 A  ERRORB¢ff'
2018-11-26 00:57:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:57:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:57:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 00:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 00:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-26 00:57:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 00:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 00:57:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:57:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:57:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:57:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:57:58 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-11-26 00:58:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:58:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 00:58:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 00:58:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 00:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:58:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 00:58:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:58:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:58:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:58:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:58:58 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-26 00:59:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 00:59:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:59:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 00:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 00:59:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 00:59:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:59:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:59:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:59:58 [WARNING ] (13, 1, 'bot')
2018-11-26 00:59:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 00:59:58 [DEBUG   ] Finished updating board flags in 1.132 seconds
2018-11-26 01:00:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 01:00:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:00:48 [DEBUG   ] Got command RPT from MCS: ref #628689
2018-11-26 01:00:48 [DEBUG   ] summary = ERROR
2018-11-26 01:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628689  13 58448  3648557 A  ERRORERROR'
2018-11-26 01:00:48 [DEBUG   ] Got command RPT from MCS: ref #628690
2018-11-26 01:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628690  77 58448  3648558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:00:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-26 01:00:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:00:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:00:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:00:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:00:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:00:58 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-26 01:01:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:01:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:01:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:01:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:01:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:01:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:01:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:01:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:01:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:01:58 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-26 01:02:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:02:29 [DEBUG   ] Got command RPT from MCS: ref #628708
2018-11-26 01:02:29 [DEBUG   ] summary = ERROR
2018-11-26 01:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628708  13 58448  3749717 A  ERRORERROR'
2018-11-26 01:02:29 [DEBUG   ] Got command RPT from MCS: ref #628709
2018-11-26 01:02:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628709  77 58448  3749921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:02:30 [DEBUG   ] Got command RPT from MCS: ref #628710
2018-11-26 01:02:30 [DEBUG   ] summary = ERROR
2018-11-26 01:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628710  13 58448  3750113 A  ERRORERROR'
2018-11-26 01:02:30 [DEBUG   ] Got command RPT from MCS: ref #628712
2018-11-26 01:02:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628712  77 58448  3750317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:02:30 [DEBUG   ] Got command RPT from MCS: ref #628713
2018-11-26 01:02:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628713  12 58448  3750521 A  ERRORB¡ff'
2018-11-26 01:02:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:02:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 01:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 01:02:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:02:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:02:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:02:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:02:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:02:59 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-11-26 01:03:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:03:36 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-11-26 01:03:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:03:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:03:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 01:03:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:03:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:03:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:03:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:03:59 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-11-26 01:04:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:04:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 01:04:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 01:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 01:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-26 01:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:04:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:04:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:04:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:04:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:04:58 [WARNING ] (13, 1, 'bot')
2018-11-26 01:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:04:58 [DEBUG   ] Finished updating board flags in 1.261 seconds
2018-11-26 01:05:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:05:36 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-11-26 01:05:48 [DEBUG   ] Got command RPT from MCS: ref #628722
2018-11-26 01:05:48 [DEBUG   ] summary = ERROR
2018-11-26 01:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628722  13 58448  3948553 A  ERRORERROR'
2018-11-26 01:05:48 [DEBUG   ] Got command RPT from MCS: ref #628723
2018-11-26 01:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628723  77 58448  3948554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:05:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:05:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-26 01:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:05:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:05:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 01:05:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:05:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:05:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:05:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:05:59 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-11-26 01:06:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:06:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:06:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:06:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 01:06:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:06:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:06:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:06:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:06:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:06:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:06:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:06:59 [DEBUG   ] Finished updating board flags in 1.655 seconds
2018-11-26 01:07:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:07:29 [DEBUG   ] Got command RPT from MCS: ref #628743
2018-11-26 01:07:29 [DEBUG   ] summary = ERROR
2018-11-26 01:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628743  13 58448  4049809 A  ERRORERROR'
2018-11-26 01:07:30 [DEBUG   ] Got command RPT from MCS: ref #628744
2018-11-26 01:07:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628744  77 58448  4050001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:07:30 [DEBUG   ] Got command RPT from MCS: ref #628745
2018-11-26 01:07:30 [DEBUG   ] summary = ERROR
2018-11-26 01:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628745  13 58448  4050205 A  ERRORERROR'
2018-11-26 01:07:30 [DEBUG   ] Got command RPT from MCS: ref #628746
2018-11-26 01:07:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628746  77 58448  4050409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:07:30 [DEBUG   ] Got command RPT from MCS: ref #628747
2018-11-26 01:07:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628747  12 58448  4050613 A  ERRORB¢ff'
2018-11-26 01:07:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:07:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 01:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-26 01:07:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-26 01:07:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:07:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:07:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:07:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:07:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:07:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:07:59 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-11-26 01:08:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:08:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:08:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:08:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:08:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:08:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 01:08:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:08:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:08:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:08:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:08:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:08:59 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-11-26 01:09:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:09:36 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-11-26 01:09:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 01:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 01:09:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:09:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:09:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 01:09:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:09:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:09:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:09:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:09:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:09:59 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-11-26 01:10:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:10:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:10:48 [DEBUG   ] Got command RPT from MCS: ref #628752
2018-11-26 01:10:48 [DEBUG   ] summary = ERROR
2018-11-26 01:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628752  13 58448  4248557 A  ERRORERROR'
2018-11-26 01:10:48 [DEBUG   ] Got command RPT from MCS: ref #628753
2018-11-26 01:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628753  77 58448  4248558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:10:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:10:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-26 01:10:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:10:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 01:10:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:10:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:10:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:10:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:10:59 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-11-26 01:11:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:11:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:11:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-26 01:11:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-26 01:11:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:11:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:11:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:11:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:11:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:11:59 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-26 01:12:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:12:29 [DEBUG   ] Got command RPT from MCS: ref #628771
2018-11-26 01:12:29 [DEBUG   ] summary = ERROR
2018-11-26 01:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628771  13 58448  4349885 A  ERRORERROR'
2018-11-26 01:12:30 [DEBUG   ] Got command RPT from MCS: ref #628772
2018-11-26 01:12:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628772  77 58448  4350089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:12:30 [DEBUG   ] Got command RPT from MCS: ref #628773
2018-11-26 01:12:30 [DEBUG   ] summary = ERROR
2018-11-26 01:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628773  13 58448  4350293 A  ERRORERROR'
2018-11-26 01:12:30 [DEBUG   ] Got command RPT from MCS: ref #628775
2018-11-26 01:12:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628775  77 58448  4350497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:12:30 [DEBUG   ] Got command RPT from MCS: ref #628776
2018-11-26 01:12:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628776  12 58448  4350689 A  ERRORB¢ff'
2018-11-26 01:12:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:12:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-26 01:12:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:12:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:12:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:12:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:12:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:12:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:12:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:12:59 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-26 01:13:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 01:13:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:13:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 01:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:13:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:13:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:13:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:13:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:13:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:13:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:13:59 [DEBUG   ] Finished updating board flags in 1.091 seconds
2018-11-26 01:14:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:14:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:14:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:14:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-26 01:15:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 01:15:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:15:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:15:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:15:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:15:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:15:00 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-11-26 01:15:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:15:36 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-11-26 01:15:48 [DEBUG   ] Got command RPT from MCS: ref #628789
2018-11-26 01:15:48 [DEBUG   ] summary = ERROR
2018-11-26 01:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628789  13 58448  4548561 A  ERRORERROR'
2018-11-26 01:15:48 [DEBUG   ] Got command RPT from MCS: ref #628790
2018-11-26 01:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628790  77 58448  4548562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:15:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:16:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:16:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:16:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:16:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:16:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:16:00 [DEBUG   ] Finished updating board flags in 1.945 seconds
2018-11-26 01:16:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:16:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:16:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:16:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 01:16:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:16:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-26 01:16:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:16:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:16:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:16:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:16:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:16:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:16:59 [DEBUG   ] Finished updating board flags in 1.228 seconds
2018-11-26 01:17:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:17:29 [DEBUG   ] Got command RPT from MCS: ref #628806
2018-11-26 01:17:29 [DEBUG   ] summary = ERROR
2018-11-26 01:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628806  13 58448  4649981 A  ERRORERROR'
2018-11-26 01:17:30 [DEBUG   ] Got command RPT from MCS: ref #628807
2018-11-26 01:17:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628807  77 58448  4650173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:17:30 [DEBUG   ] Got command RPT from MCS: ref #628808
2018-11-26 01:17:30 [DEBUG   ] summary = ERROR
2018-11-26 01:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628808  13 58448  4650377 A  ERRORERROR'
2018-11-26 01:17:30 [DEBUG   ] Got command RPT from MCS: ref #628809
2018-11-26 01:17:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628809  77 58448  4650581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:17:30 [DEBUG   ] Got command RPT from MCS: ref #628810
2018-11-26 01:17:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628810  12 58448  4650773 A  ERRORB¡ff'
2018-11-26 01:17:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:17:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:17:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:17:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:17:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:17:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:17:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:17:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:17:59 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-11-26 01:18:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:18:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:18:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 01:18:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:18:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:18:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:18:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:18:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:18:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:18:59 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-11-26 01:19:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:19:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:19:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:19:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:19:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:19:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 01:19:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:19:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:19:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:19:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:19:59 [DEBUG   ] Finished updating board flags in 1.230 seconds
2018-11-26 01:20:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:20:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:20:48 [DEBUG   ] Got command RPT from MCS: ref #628815
2018-11-26 01:20:48 [DEBUG   ] summary = ERROR
2018-11-26 01:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628815  13 58448  4848553 A  ERRORERROR'
2018-11-26 01:20:48 [DEBUG   ] Got command RPT from MCS: ref #628816
2018-11-26 01:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628816  77 58448  4848554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:20:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:20:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:20:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-26 01:20:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:20:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:20:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:20:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:20:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:20:59 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-11-26 01:21:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:21:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:21:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 01:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-26 01:22:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 01:22:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:22:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:22:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:22:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:22:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:22:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:22:00 [DEBUG   ] Finished updating board flags in 1.739 seconds
2018-11-26 01:22:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:22:30 [DEBUG   ] Got command RPT from MCS: ref #628838
2018-11-26 01:22:30 [DEBUG   ] summary = ERROR
2018-11-26 01:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628838  13 58448  4950057 A  ERRORERROR'
2018-11-26 01:22:30 [DEBUG   ] Got command RPT from MCS: ref #628839
2018-11-26 01:22:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628839  77 58448  4950261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:22:30 [DEBUG   ] Got command RPT from MCS: ref #628840
2018-11-26 01:22:30 [DEBUG   ] summary = ERROR
2018-11-26 01:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628840  13 58448  4950465 A  ERRORERROR'
2018-11-26 01:22:30 [DEBUG   ] Got command RPT from MCS: ref #628842
2018-11-26 01:22:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628842  77 58448  4950657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:22:30 [DEBUG   ] Got command RPT from MCS: ref #628843
2018-11-26 01:22:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628843  12 58448  4950861 A  ERRORB¡ff'
2018-11-26 01:22:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:22:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-26 01:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:22:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2018-11-26 01:22:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:22:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:22:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:22:59 [WARNING ] (13, 1, 'bot')
2018-11-26 01:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:22:59 [DEBUG   ] Finished updating board flags in 0.977 seconds
2018-11-26 01:23:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:23:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:23:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:23:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:24:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:24:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:24:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:24:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:24:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:24:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:24:00 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-11-26 01:24:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:24:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:24:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:25:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:25:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:25:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:25:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:25:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:25:00 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-26 01:25:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:25:36 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-11-26 01:25:48 [DEBUG   ] Got command RPT from MCS: ref #628852
2018-11-26 01:25:48 [DEBUG   ] summary = ERROR
2018-11-26 01:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628852  13 58448  5148561 A  ERRORERROR'
2018-11-26 01:25:48 [DEBUG   ] Got command RPT from MCS: ref #628853
2018-11-26 01:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628853  77 58448  5148562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:25:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 01:25:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:26:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:26:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-26 01:26:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:26:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:26:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:26:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:26:00 [DEBUG   ] Finished updating board flags in 1.029 seconds
2018-11-26 01:26:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:26:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:26:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 01:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:27:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:27:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 01:27:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:27:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:27:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:27:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:27:01 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-11-26 01:27:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 01:27:30 [DEBUG   ] Got command RPT from MCS: ref #628869
2018-11-26 01:27:30 [DEBUG   ] summary = ERROR
2018-11-26 01:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628869  13 58448  5250145 A  ERRORERROR'
2018-11-26 01:27:30 [DEBUG   ] Got command RPT from MCS: ref #628870
2018-11-26 01:27:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628870  77 58448  5250349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:27:30 [DEBUG   ] Got command RPT from MCS: ref #628871
2018-11-26 01:27:30 [DEBUG   ] summary = ERROR
2018-11-26 01:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628871  13 58448  5250553 A  ERRORERROR'
2018-11-26 01:27:30 [DEBUG   ] Got command RPT from MCS: ref #628872
2018-11-26 01:27:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628872  77 58448  5250745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:27:30 [DEBUG   ] Got command RPT from MCS: ref #628873
2018-11-26 01:27:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628873  12 58448  5250949 A  ERRORB¡ff'
2018-11-26 01:27:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 01:27:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 01:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-26 01:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 01:28:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-26 01:28:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:28:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:28:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:28:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:28:00 [DEBUG   ] Finished updating board flags in 0.970 seconds
2018-11-26 01:28:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 01:28:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 01:28:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 01:29:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-26 01:29:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:29:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:29:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:29:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:29:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:29:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:29:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:29:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:29:01 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-11-26 01:29:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 01:29:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 01:29:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 01:30:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 01:30:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:30:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:30:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:30:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:30:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:30:00 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-11-26 01:30:15 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-26 01:30:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 01:30:48 [DEBUG   ] Got command RPT from MCS: ref #628882
2018-11-26 01:30:48 [DEBUG   ] summary = ERROR
2018-11-26 01:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628882  13 58448  5448565 A  ERRORERROR'
2018-11-26 01:30:48 [DEBUG   ] Got command RPT from MCS: ref #628883
2018-11-26 01:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628883  77 58448  5448566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:30:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:31:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:31:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:31:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:31:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:31:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:31:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:31:00 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-26 01:31:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:31:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:31:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-26 01:32:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:32:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-26 01:32:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:32:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:32:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:32:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:32:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-26 01:32:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 01:32:30 [DEBUG   ] Got command RPT from MCS: ref #628901
2018-11-26 01:32:30 [DEBUG   ] summary = ERROR
2018-11-26 01:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628901  13 58448  5550233 A  ERRORERROR'
2018-11-26 01:32:30 [DEBUG   ] Got command RPT from MCS: ref #628902
2018-11-26 01:32:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628902  77 58448  5550437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:32:30 [DEBUG   ] Got command RPT from MCS: ref #628903
2018-11-26 01:32:30 [DEBUG   ] summary = ERROR
2018-11-26 01:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628903  13 58448  5550629 A  ERRORERROR'
2018-11-26 01:32:30 [DEBUG   ] Got command RPT from MCS: ref #628905
2018-11-26 01:32:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628905  77 58448  5550833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:32:31 [DEBUG   ] Got command RPT from MCS: ref #628907
2018-11-26 01:32:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628907  12 58448  5551037 A  ERRORB¡ff'
2018-11-26 01:32:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 01:32:47 [DEBUG   ] Got command STP from MCS: ref #628911
2018-11-26 01:32:47 [INFO    ] Finished processing BAM request
2018-11-26 01:32:47 [INFO    ] Shutdown the adder chain on beam #2
2018-11-26 01:32:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   628911   8 58448  5567109 A  ERROR'
2018-11-26 01:32:47 [DEBUG   ] Got command STP from MCS: ref #628912
2018-11-26 01:32:47 [INFO    ] Finished processing BAM request
2018-11-26 01:32:47 [INFO    ] Shutdown the adder chain on beam #4
2018-11-26 01:32:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   628912   8 58448  5567113 A  ERROR'
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-26 01:32:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-26 01:32:47 [DEBUG   ] spawn_process: at 2018-11-26 01:32:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-26 01:32:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 01:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:33:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:33:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:33:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:33:00 [WARNING ] (13, 1, 'bot')
2018-11-26 01:33:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:33:00 [DEBUG   ] Finished updating board flags in 0.959 seconds
2018-11-26 01:33:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 01:33:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 01:33:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 01:34:00 [DEBUG   ] Got command RPT from MCS: ref #628918
2018-11-26 01:34:00 [DEBUG   ] summary = ERROR
2018-11-26 01:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628918  13 58448  5640413 A  ERRORERROR'
2018-11-26 01:34:00 [DEBUG   ] Got command RPT from MCS: ref #628919
2018-11-26 01:34:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628919  77 58448  5640414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:34:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:34:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:34:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:34:01 [WARNING ] (13, 1, 'bot')
2018-11-26 01:34:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:34:01 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-26 01:34:05 [DEBUG   ] Got command INI from MCS: ref #628924
2018-11-26 01:34:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-26 01:34:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   628924   8 58448  5645434 ABOOTING'
2018-11-26 01:34:25 [INFO    ] -------------------
2018-11-26 01:34:25 [INFO    ]  LWA board status
2018-11-26 01:34:25 [INFO    ] -------------------
2018-11-26 01:34:25 [INFO    ] DP 1: 2 lwa27
2018-11-26 01:34:25 [INFO    ] DP 1: 3 lwa24
2018-11-26 01:34:25 [INFO    ] DP 1: 4 lwa23
2018-11-26 01:34:25 [INFO    ] DP 1: 5 lwa18
2018-11-26 01:34:25 [INFO    ] DP 1: 6 lwa10
2018-11-26 01:34:25 [INFO    ] DP 1: 7 lwa32
2018-11-26 01:34:25 [INFO    ] DP 1: 8 lwa11
2018-11-26 01:34:25 [INFO    ] DP 1: 9 lwa30
2018-11-26 01:34:25 [INFO    ] DP 1: 10 lwa12
2018-11-26 01:34:25 [INFO    ] DP 1: 11 lwa8
2018-11-26 01:34:25 [INFO    ] DP 1: 12 lwa13
2018-11-26 01:34:25 [INFO    ] DP 1: 13 lwa26
2018-11-26 01:34:25 [INFO    ] DP 1: 14 lwa14
2018-11-26 01:34:25 [INFO    ] DP 1: 16 lwa22
2018-11-26 01:34:25 [INFO    ] DP 1: 17 lwa20
2018-11-26 01:34:25 [INFO    ] DP 1: 18 lwa1
2018-11-26 01:34:25 [INFO    ] DP 1: 19 lwa5
2018-11-26 01:34:25 [INFO    ] DP 1: 20 lwa25
2018-11-26 01:34:25 [INFO    ] DP 1: 21 lwa35
2018-11-26 01:34:25 [INFO    ] DP 1: 22 lwa19
2018-11-26 01:34:25 [INFO    ] DP 1: 23 lwa21
2018-11-26 01:34:25 [INFO    ] DP 1: 24 lwa6
2018-11-26 01:34:25 [INFO    ] DP 1: 25 lwa7
2018-11-26 01:34:25 [INFO    ] DP 1: 26 lwa33
2018-11-26 01:34:25 [INFO    ] DP 1: 27 lwa15
2018-11-26 01:34:25 [INFO    ] DP 1: 28 lwa28
2018-11-26 01:34:25 [INFO    ] DP 2: 1 lwa16
2018-11-26 01:34:25 [INFO    ] DP 2: 15 lwa34
2018-11-26 01:34:25 [INFO    ] Total of 28 boards
2018-11-26 01:34:25 [INFO    ] Total of 260 stands
2018-11-26 01:34:25 [INFO    ] -------------------
2018-11-26 01:34:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25668
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25669
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25670
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25671
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25672
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25673
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25674
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25675
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25676
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25677
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25678
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25679
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25680
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25681
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25682
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25683
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25684
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25685
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25686
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25687
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25688
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25689
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25690
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25691
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25692
2018-11-26 01:34:32 [DEBUG   ] 2018-11-26 01:34:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25693
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25668 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25669 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25670 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25671 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25672 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25673 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25674 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25675 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25676 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25677 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25678 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25679 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25680 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25681 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25682 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25683 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25684 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25685 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25686 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25687 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25688 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25689 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25690 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25691 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25692 exited with status 0
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25693 exited with status 0
2018-11-26 01:34:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] spawn_process: at 2018-11-26 01:34:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25720
2018-11-26 01:34:44 [DEBUG   ] 2018-11-26 01:34:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25721
2018-11-26 01:34:50 [DEBUG   ] 2018-11-26 01:34:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25720 exited with status 0
2018-11-26 01:34:50 [DEBUG   ] 2018-11-26 01:34:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25721 exited with status 0
2018-11-26 01:34:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-26 01:34:50 [DEBUG   ] spawn_process: at 2018-11-26 01:34:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-26 01:34:50 [DEBUG   ] spawn_process: at 2018-11-26 01:34:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-26 01:34:50 [INFO    ] Setting Beam 1 xbars
2018-11-26 01:34:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-26 01:34:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-26 01:34:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-26 01:34:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-26 01:34:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-26 01:34:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-26 01:34:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-26 01:34:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-26 01:34:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-26 01:34:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-26 01:34:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-26 01:34:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-26 01:34:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-26 01:34:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-26 01:34:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-26 01:34:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-26 01:34:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-26 01:34:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-26 01:34:56 [INFO    ] Setting Beam 2 xbars
2018-11-26 01:34:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-26 01:34:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-26 01:34:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-26 01:34:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-26 01:34:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-26 01:34:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-26 01:34:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-26 01:34:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-26 01:34:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-26 01:34:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-26 01:34:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-26 01:35:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-26 01:35:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-26 01:35:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-26 01:35:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-26 01:35:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-26 01:35:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-26 01:35:01 [INFO    ] Setting Beam 3 xbars
2018-11-26 01:35:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-26 01:35:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-26 01:35:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-26 01:35:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-26 01:35:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-26 01:35:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-26 01:35:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-26 01:35:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-26 01:35:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-26 01:35:07 [INFO    ] Setting Beam 4 xbars
2018-11-26 01:35:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-26 01:35:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-26 01:35:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-26 01:35:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-26 01:35:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-26 01:35:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-26 01:35:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-26 01:35:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-26 01:35:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-26 01:35:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-26 01:35:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-26 01:35:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-26 01:35:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-26 01:35:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-26 01:35:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-26 01:35:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-26 01:35:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-26 01:35:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-26 01:35:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-26 01:35:12 [INFO    ] All xbars set
2018-11-26 01:35:12 [INFO    ] Setting adder chain routing for all beams
2018-11-26 01:35:17 [INFO    ] Setting beam ids
2018-11-26 01:35:27 [INFO    ] Starting beam delay calibration
2018-11-26 01:35:39 [INFO    ] Beam 1 latency is 5736
2018-11-26 01:35:39 [INFO    ] Beam 2 latency is 5759
2018-11-26 01:35:39 [INFO    ] Beam 3 latency is 5732
2018-11-26 01:35:39 [INFO    ] Beam 4 latency is 5728
2018-11-26 01:35:39 [INFO    ] Stop calibration
2018-11-26 01:35:47 [INFO    ] Beam delay calibration successful
2018-11-26 01:35:47 [INFO    ] Calibration passed
2018-11-26 01:35:47 [DEBUG   ] spawn_process: at 2018-11-26 01:35:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-26 01:35:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-26 01:35:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-26 01:35:47 [DEBUG   ] spawn_process: at 2018-11-26 01:35:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-26 01:35:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-26 01:35:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-26 01:35:47 [DEBUG   ] spawn_process: at 2018-11-26 01:35:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-26 01:35:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-26 01:35:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-26 01:35:47 [DEBUG   ] spawn_process: at 2018-11-26 01:35:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-26 01:35:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-26 01:35:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-26 01:35:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-26 01:35:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 284 ms (1543196148.287 s) with PID 27301 and time 1543196149
2018-11-26 01:35:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-26 01:35:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 375 ms (1543196148.377 s) with PID 27304 and time 1543196149
2018-11-26 01:35:48 [DEBUG   ] Got command RPT from MCS: ref #628956
2018-11-26 01:35:48 [DEBUG   ] summary = BOOTING
2018-11-26 01:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628956  15 58448  5748557 ABOOTINGBOOTING'
2018-11-26 01:35:48 [DEBUG   ] Got command RPT from MCS: ref #628957
2018-11-26 01:35:48 [DEBUG   ] info = Calibration passed
2018-11-26 01:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628957  26 58448  5748558 ABOOTINGCalibration passed'
2018-11-26 01:35:49 [DEBUG   ] Finished updating ant stats in 0.871 seconds
2018-11-26 01:35:49 [INFO    ] Started antennas statistics background thread
2018-11-26 01:35:49 [INFO    ] Started board flags background thread
2018-11-26 01:35:49 [INFO    ] Started BAM background thread
2018-11-26 01:35:49 [INFO    ] Finished the INI process (ref. #628924) in 104.068 s
2018-11-26 01:35:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:35:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:35:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:35:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:35:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:35:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:35:50 [DEBUG   ] Finished updating board flags in 1.054 seconds
2018-11-26 01:36:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:36:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:36:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:36:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:36:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:36:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:36:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:36:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:36:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:36:50 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-11-26 01:37:05 [DEBUG   ] Got command RPT from MCS: ref #628977
2018-11-26 01:37:05 [DEBUG   ] summary = ERROR
2018-11-26 01:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628977  13 58448  5825421 A  ERRORERROR'
2018-11-26 01:37:05 [DEBUG   ] Got command RPT from MCS: ref #628978
2018-11-26 01:37:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628978  77 58448  5825422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:37:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:37:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:37:30 [DEBUG   ] Got command RPT from MCS: ref #628979
2018-11-26 01:37:30 [DEBUG   ] summary = ERROR
2018-11-26 01:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628979  13 58448  5850309 A  ERRORERROR'
2018-11-26 01:37:30 [DEBUG   ] Got command RPT from MCS: ref #628980
2018-11-26 01:37:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628980  77 58448  5850513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:37:30 [DEBUG   ] Got command RPT from MCS: ref #628981
2018-11-26 01:37:30 [DEBUG   ] summary = ERROR
2018-11-26 01:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628981  13 58448  5850717 A  ERRORERROR'
2018-11-26 01:37:30 [DEBUG   ] Got command RPT from MCS: ref #628982
2018-11-26 01:37:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628982  77 58448  5850931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:37:31 [DEBUG   ] Got command RPT from MCS: ref #628983
2018-11-26 01:37:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628983  12 58448  5851121 A  ERRORB™™š'
2018-11-26 01:37:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 01:37:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:37:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:37:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:37:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:37:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:37:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:37:50 [DEBUG   ] Finished updating board flags in 1.286 seconds
2018-11-26 01:38:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:38:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:38:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:38:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:38:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:38:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:38:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:38:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:38:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:38:51 [DEBUG   ] Finished updating board flags in 1.751 seconds
2018-11-26 01:39:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 01:39:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:39:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:39:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:39:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:39:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:39:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:39:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:39:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:39:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:39:51 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-11-26 01:40:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 01:40:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:40:48 [DEBUG   ] Got command RPT from MCS: ref #628988
2018-11-26 01:40:48 [DEBUG   ] summary = ERROR
2018-11-26 01:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628988  13 58448  6048561 A  ERRORERROR'
2018-11-26 01:40:48 [DEBUG   ] Got command RPT from MCS: ref #628989
2018-11-26 01:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   628989  77 58448  6048562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:40:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:40:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:40:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:40:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:40:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:40:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:40:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:40:50 [DEBUG   ] Finished updating board flags in 1.047 seconds
2018-11-26 01:41:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 01:41:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:41:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 01:41:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:41:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:41:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:41:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:41:50 [WARNING ] (13, 1, 'bot')
2018-11-26 01:41:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:41:50 [DEBUG   ] Finished updating board flags in 0.979 seconds
2018-11-26 01:42:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:42:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:42:30 [DEBUG   ] Got command RPT from MCS: ref #629007
2018-11-26 01:42:30 [DEBUG   ] summary = ERROR
2018-11-26 01:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629007  13 58448  6150393 A  ERRORERROR'
2018-11-26 01:42:30 [DEBUG   ] Got command RPT from MCS: ref #629008
2018-11-26 01:42:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629008  77 58448  6150597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:42:30 [DEBUG   ] Got command RPT from MCS: ref #629009
2018-11-26 01:42:30 [DEBUG   ] summary = ERROR
2018-11-26 01:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629009  13 58448  6150801 A  ERRORERROR'
2018-11-26 01:42:30 [DEBUG   ] Got command RPT from MCS: ref #629011
2018-11-26 01:42:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629011  77 58448  6150993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:42:31 [DEBUG   ] Got command RPT from MCS: ref #629013
2018-11-26 01:42:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629013  12 58448  6151197 A  ERRORB˜™š'
2018-11-26 01:42:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:42:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:42:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:42:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:42:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:42:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:42:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:42:51 [DEBUG   ] Finished updating board flags in 1.334 seconds
2018-11-26 01:43:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:43:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:43:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 01:43:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:43:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:43:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:43:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:43:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:43:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:43:51 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-26 01:44:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:44:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 01:44:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 01:44:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:44:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:44:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:44:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:44:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:44:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:44:51 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-11-26 01:45:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:45:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 01:45:48 [DEBUG   ] Got command RPT from MCS: ref #629025
2018-11-26 01:45:48 [DEBUG   ] summary = ERROR
2018-11-26 01:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629025  13 58448  6348561 A  ERRORERROR'
2018-11-26 01:45:48 [DEBUG   ] Got command RPT from MCS: ref #629026
2018-11-26 01:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629026  77 58448  6348562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:45:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 01:45:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:45:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:45:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:45:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:45:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:45:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:45:51 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-26 01:46:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 01:46:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 01:46:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 01:46:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:46:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:46:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:46:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:46:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:46:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:46:51 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-26 01:47:09 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-26 01:47:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 01:47:30 [DEBUG   ] Got command RPT from MCS: ref #629042
2018-11-26 01:47:30 [DEBUG   ] summary = ERROR
2018-11-26 01:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629042  13 58448  6450481 A  ERRORERROR'
2018-11-26 01:47:30 [DEBUG   ] Got command RPT from MCS: ref #629043
2018-11-26 01:47:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629043  77 58448  6450673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:47:30 [DEBUG   ] Got command RPT from MCS: ref #629044
2018-11-26 01:47:30 [DEBUG   ] summary = ERROR
2018-11-26 01:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629044  13 58448  6450877 A  ERRORERROR'
2018-11-26 01:47:31 [DEBUG   ] Got command RPT from MCS: ref #629045
2018-11-26 01:47:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629045  77 58448  6451081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:47:31 [DEBUG   ] Got command RPT from MCS: ref #629046
2018-11-26 01:47:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629046  12 58448  6451273 A  ERRORB™™š'
2018-11-26 01:47:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 01:47:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:47:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:47:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:47:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:47:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:47:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:47:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:47:51 [DEBUG   ] Finished updating board flags in 0.983 seconds
2018-11-26 01:48:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:48:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:48:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:48:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:48:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 01:48:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:48:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:48:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:48:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:48:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:48:52 [DEBUG   ] Finished updating board flags in 1.869 seconds
2018-11-26 01:49:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:49:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 01:49:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 01:49:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:49:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:49:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:49:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:49:51 [WARNING ] (13, 1, 'bot')
2018-11-26 01:49:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:49:51 [DEBUG   ] Finished updating board flags in 1.182 seconds
2018-11-26 01:50:00 [DEBUG   ] Got command TBN from MCS: ref #629051
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-11-26 01:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   629051   8 58448  6600454 A  ERROR'
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1543197001']
2018-11-26 01:50:00 [DEBUG   ] spawn_process: at 2018-11-26 01:50:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1543197001']
2018-11-26 01:50:00 [INFO    ] Finished spawning TBN in 0.050 s
2018-11-26 01:50:10 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2018-11-26 01:50:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 01:50:48 [DEBUG   ] Got command RPT from MCS: ref #629052
2018-11-26 01:50:48 [DEBUG   ] summary = ERROR
2018-11-26 01:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629052  13 58448  6648565 A  ERRORERROR'
2018-11-26 01:50:48 [DEBUG   ] Got command RPT from MCS: ref #629053
2018-11-26 01:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629053  77 58448  6648566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:50:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 01:50:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:50:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:50:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:50:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:50:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:50:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:50:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:50:52 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-11-26 01:51:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 01:51:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 01:51:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 01:51:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:51:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:51:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:51:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:51:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:51:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:51:52 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-11-26 01:52:10 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-26 01:52:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 01:52:30 [DEBUG   ] Got command RPT from MCS: ref #629075
2018-11-26 01:52:30 [DEBUG   ] summary = ERROR
2018-11-26 01:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629075  13 58448  6750561 A  ERRORERROR'
2018-11-26 01:52:30 [DEBUG   ] Got command RPT from MCS: ref #629076
2018-11-26 01:52:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629076  77 58448  6750753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:52:30 [DEBUG   ] Got command RPT from MCS: ref #629077
2018-11-26 01:52:30 [DEBUG   ] summary = ERROR
2018-11-26 01:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629077  13 58448  6750957 A  ERRORERROR'
2018-11-26 01:52:31 [DEBUG   ] Got command RPT from MCS: ref #629079
2018-11-26 01:52:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629079  77 58448  6751161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:52:31 [DEBUG   ] Got command RPT from MCS: ref #629081
2018-11-26 01:52:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629081  12 58448  6751353 A  ERRORB˜™š'
2018-11-26 01:52:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:52:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:52:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:52:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:52:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:52:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:52:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:52:52 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-26 01:53:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 01:53:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 01:53:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 01:53:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:53:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:53:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:53:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:53:52 [WARNING ] (13, 1, 'bot')
2018-11-26 01:53:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:53:52 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-26 01:54:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 01:54:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 01:54:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 01:54:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:54:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:54:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:54:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:54:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:54:53 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-11-26 01:55:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 01:55:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 01:55:48 [DEBUG   ] Got command RPT from MCS: ref #629089
2018-11-26 01:55:48 [DEBUG   ] summary = ERROR
2018-11-26 01:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629089  13 58448  6948569 A  ERRORERROR'
2018-11-26 01:55:48 [DEBUG   ] Got command RPT from MCS: ref #629090
2018-11-26 01:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629090  77 58448  6948570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:55:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 01:55:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 01:55:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:55:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:55:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:55:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:55:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:55:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:55:53 [DEBUG   ] Finished updating board flags in 2.179 seconds
2018-11-26 01:56:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 01:56:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 01:56:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 01:56:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:56:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:56:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:56:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:56:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:56:53 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-11-26 01:57:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 01:57:30 [DEBUG   ] Got command RPT from MCS: ref #629106
2018-11-26 01:57:30 [DEBUG   ] summary = ERROR
2018-11-26 01:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629106  13 58448  7050634 A  ERRORERROR'
2018-11-26 01:57:30 [DEBUG   ] Got command RPT from MCS: ref #629107
2018-11-26 01:57:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629107  77 58448  7050837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:57:31 [DEBUG   ] Got command RPT from MCS: ref #629108
2018-11-26 01:57:31 [DEBUG   ] summary = ERROR
2018-11-26 01:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629108  13 58448  7051041 A  ERRORERROR'
2018-11-26 01:57:31 [DEBUG   ] Got command RPT from MCS: ref #629109
2018-11-26 01:57:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 01:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629109  77 58448  7051245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 01:57:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:57:31 [DEBUG   ] Got command RPT from MCS: ref #629110
2018-11-26 01:57:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 01:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629110  12 58448  7051437 A  ERRORB˜™š'
2018-11-26 01:57:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:57:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:57:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:57:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:57:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:57:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:57:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:57:53 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-11-26 01:58:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 01:58:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 01:58:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 01:58:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:58:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:58:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:58:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:58:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:58:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:58:53 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-26 01:59:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 01:59:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 01:59:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 01:59:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 01:59:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 01:59:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:59:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:59:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:59:53 [WARNING ] (13, 1, 'bot')
2018-11-26 01:59:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 01:59:53 [DEBUG   ] Finished updating board flags in 2.044 seconds
2018-11-26 02:00:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:00:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 02:00:48 [DEBUG   ] Got command RPT from MCS: ref #629119
2018-11-26 02:00:48 [DEBUG   ] summary = ERROR
2018-11-26 02:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629119  13 58448  7248565 A  ERRORERROR'
2018-11-26 02:00:48 [DEBUG   ] Got command RPT from MCS: ref #629120
2018-11-26 02:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629120  77 58448  7248566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:00:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 02:00:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:00:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:00:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:00:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:00:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:00:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:00:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:00:53 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-26 02:01:11 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-26 02:01:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 02:01:52 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2018-11-26 02:01:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:01:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:01:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:01:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:01:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:01:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:01:53 [DEBUG   ] Finished updating board flags in 1.858 seconds
2018-11-26 02:02:12 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-11-26 02:02:30 [DEBUG   ] Got command RPT from MCS: ref #629138
2018-11-26 02:02:30 [DEBUG   ] summary = ERROR
2018-11-26 02:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629138  13 58448  7350713 A  ERRORERROR'
2018-11-26 02:02:30 [DEBUG   ] Got command RPT from MCS: ref #629139
2018-11-26 02:02:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629139  77 58448  7350917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:02:31 [DEBUG   ] Got command RPT from MCS: ref #629140
2018-11-26 02:02:31 [DEBUG   ] summary = ERROR
2018-11-26 02:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629140  13 58448  7351121 A  ERRORERROR'
2018-11-26 02:02:31 [DEBUG   ] Got command RPT from MCS: ref #629142
2018-11-26 02:02:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629142  77 58448  7351326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:02:31 [DEBUG   ] Got command RPT from MCS: ref #629143
2018-11-26 02:02:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629143  12 58448  7351517 A  ERRORB˜™š'
2018-11-26 02:02:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 02:02:52 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-11-26 02:02:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:02:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:02:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:02:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:02:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:02:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:02:53 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-26 02:03:12 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-11-26 02:03:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 02:03:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:03:52 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-11-26 02:03:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:03:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:03:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:03:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:03:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:03:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:03:53 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-26 02:04:12 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-11-26 02:04:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 02:04:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:04:53 [DEBUG   ] Finished updating ant stats in 1.431 seconds
2018-11-26 02:04:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:04:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:04:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:04:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:04:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:04:53 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-11-26 02:05:13 [DEBUG   ] Finished updating ant stats in 1.369 seconds
2018-11-26 02:05:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 02:05:48 [DEBUG   ] Got command RPT from MCS: ref #629152
2018-11-26 02:05:48 [DEBUG   ] summary = ERROR
2018-11-26 02:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629152  13 58448  7548565 A  ERRORERROR'
2018-11-26 02:05:48 [DEBUG   ] Got command RPT from MCS: ref #629153
2018-11-26 02:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629153  77 58448  7548566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:05:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:05:53 [DEBUG   ] Finished updating ant stats in 1.242 seconds
2018-11-26 02:05:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:05:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:05:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:05:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:05:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:05:53 [DEBUG   ] Finished updating board flags in 1.669 seconds
2018-11-26 02:06:13 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-11-26 02:06:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:06:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:06:53 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-11-26 02:06:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:06:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:06:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:06:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:06:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:06:53 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-11-26 02:07:13 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2018-11-26 02:07:30 [DEBUG   ] Got command RPT from MCS: ref #629173
2018-11-26 02:07:30 [DEBUG   ] summary = ERROR
2018-11-26 02:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629173  13 58448  7650805 A  ERRORERROR'
2018-11-26 02:07:30 [DEBUG   ] Got command RPT from MCS: ref #629174
2018-11-26 02:07:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629174  77 58448  7650997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:07:31 [DEBUG   ] Got command RPT from MCS: ref #629175
2018-11-26 02:07:31 [DEBUG   ] summary = ERROR
2018-11-26 02:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629175  13 58448  7651201 A  ERRORERROR'
2018-11-26 02:07:31 [DEBUG   ] Got command RPT from MCS: ref #629176
2018-11-26 02:07:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629176  77 58448  7651405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:07:31 [DEBUG   ] Got command RPT from MCS: ref #629177
2018-11-26 02:07:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629177  12 58448  7651597 A  ERRORB™™š'
2018-11-26 02:07:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:07:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 02:07:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:07:53 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-11-26 02:07:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:07:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:07:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:07:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:07:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:07:53 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-11-26 02:08:13 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-11-26 02:08:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 02:08:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:08:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:08:53 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-11-26 02:08:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-11-26 02:08:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:08:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:08:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:08:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:08:53 [WARNING ] (25, 5, 'bot')
2018-11-26 02:08:53 [WARNING ] (25, 5, 'bot')
2018-11-26 02:08:53 [WARNING ] (25, 5, 'bot')
2018-11-26 02:08:53 [WARNING ] (25, 5, 'bot')
2018-11-26 02:08:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:08:53 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-11-26 02:09:14 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2018-11-26 02:09:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 02:09:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:09:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:09:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:09:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:09:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:09:53 [WARNING ] (13, 1, 'bot')
2018-11-26 02:09:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:09:53 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-11-26 02:09:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 02:10:14 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 02:10:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 02:10:48 [DEBUG   ] Got command RPT from MCS: ref #629182
2018-11-26 02:10:48 [DEBUG   ] summary = ERROR
2018-11-26 02:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629182  13 58448  7848565 A  ERRORERROR'
2018-11-26 02:10:48 [DEBUG   ] Got command RPT from MCS: ref #629183
2018-11-26 02:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629183  77 58448  7848566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:10:54 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-11-26 02:10:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:10:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:10:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:10:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:10:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:10:54 [DEBUG   ] Finished updating board flags in 2.185 seconds
2018-11-26 02:11:14 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-11-26 02:11:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 02:11:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:11:54 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-11-26 02:11:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:11:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:11:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:11:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:11:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:11:54 [DEBUG   ] Finished updating board flags in 1.968 seconds
2018-11-26 02:12:14 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-11-26 02:12:30 [DEBUG   ] Got command RPT from MCS: ref #629201
2018-11-26 02:12:30 [DEBUG   ] summary = ERROR
2018-11-26 02:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629201  13 58448  7950881 A  ERRORERROR'
2018-11-26 02:12:31 [DEBUG   ] Got command RPT from MCS: ref #629202
2018-11-26 02:12:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629202  77 58448  7951085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:12:31 [DEBUG   ] Got command RPT from MCS: ref #629203
2018-11-26 02:12:31 [DEBUG   ] summary = ERROR
2018-11-26 02:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629203  13 58448  7951277 A  ERRORERROR'
2018-11-26 02:12:31 [DEBUG   ] Got command RPT from MCS: ref #629205
2018-11-26 02:12:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629205  77 58448  7951481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:12:31 [DEBUG   ] Got command RPT from MCS: ref #629207
2018-11-26 02:12:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629207  12 58448  7951685 A  ERRORB˜™š'
2018-11-26 02:12:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 02:12:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:12:54 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-11-26 02:12:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:12:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:12:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:12:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:12:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:12:54 [DEBUG   ] Finished updating board flags in 1.844 seconds
2018-11-26 02:13:15 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2018-11-26 02:13:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 02:13:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:13:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:13:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:13:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:13:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:13:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:13:54 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-11-26 02:13:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 02:14:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 02:14:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:14:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:14:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:14:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:14:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:14:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:14:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:14:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:14:55 [DEBUG   ] Finished updating board flags in 2.333 seconds
2018-11-26 02:15:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 02:15:36 [DEBUG   ] Finished updating ant stats in 1.798 seconds
2018-11-26 02:15:48 [DEBUG   ] Got command RPT from MCS: ref #629219
2018-11-26 02:15:48 [DEBUG   ] summary = ERROR
2018-11-26 02:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629219  13 58448  8148573 A  ERRORERROR'
2018-11-26 02:15:48 [DEBUG   ] Got command RPT from MCS: ref #629220
2018-11-26 02:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629220  77 58448  8148574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:15:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:15:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:15:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:15:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:15:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:15:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:15:54 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-11-26 02:15:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 02:16:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:16:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 02:16:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:16:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:16:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:16:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:16:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:16:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:16:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:16:54 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-11-26 02:16:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 02:17:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:17:30 [DEBUG   ] Got command RPT from MCS: ref #629236
2018-11-26 02:17:30 [DEBUG   ] summary = ERROR
2018-11-26 02:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629236  13 58448  8250957 A  ERRORERROR'
2018-11-26 02:17:31 [DEBUG   ] Got command RPT from MCS: ref #629237
2018-11-26 02:17:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629237  77 58448  8251161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:17:31 [DEBUG   ] Got command RPT from MCS: ref #629238
2018-11-26 02:17:31 [DEBUG   ] summary = ERROR
2018-11-26 02:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629238  13 58448  8251365 A  ERRORERROR'
2018-11-26 02:17:31 [DEBUG   ] Got command RPT from MCS: ref #629239
2018-11-26 02:17:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629239  77 58448  8251569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:17:31 [DEBUG   ] Got command RPT from MCS: ref #629240
2018-11-26 02:17:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629240  12 58448  8251761 A  ERRORB™™š'
2018-11-26 02:17:36 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2018-11-26 02:17:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:17:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:17:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:17:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:17:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:17:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:17:54 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-11-26 02:17:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 02:18:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 02:18:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 02:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:18:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:18:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:18:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:18:54 [WARNING ] (13, 1, 'bot')
2018-11-26 02:18:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:18:54 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-11-26 02:18:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 02:19:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 02:19:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 02:19:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:19:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:19:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:19:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:19:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:19:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:19:55 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-11-26 02:19:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 02:20:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:20:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 02:20:48 [DEBUG   ] Got command RPT from MCS: ref #629245
2018-11-26 02:20:48 [DEBUG   ] summary = ERROR
2018-11-26 02:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629245  13 58448  8448573 A  ERRORERROR'
2018-11-26 02:20:48 [DEBUG   ] Got command RPT from MCS: ref #629246
2018-11-26 02:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629246  77 58448  8448574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:20:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:20:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:20:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:20:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:20:55 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-11-26 02:20:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:21:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:21:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:21:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:21:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:21:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:21:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:21:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:21:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:21:55 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-11-26 02:21:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:22:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:22:31 [DEBUG   ] Got command RPT from MCS: ref #629268
2018-11-26 02:22:31 [DEBUG   ] summary = ERROR
2018-11-26 02:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629268  13 58448  8551045 A  ERRORERROR'
2018-11-26 02:22:31 [DEBUG   ] Got command RPT from MCS: ref #629269
2018-11-26 02:22:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629269  77 58448  8551237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:22:31 [DEBUG   ] Got command RPT from MCS: ref #629270
2018-11-26 02:22:31 [DEBUG   ] summary = ERROR
2018-11-26 02:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629270  13 58448  8551441 A  ERRORERROR'
2018-11-26 02:22:31 [DEBUG   ] Got command RPT from MCS: ref #629272
2018-11-26 02:22:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629272  77 58448  8551645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:22:31 [DEBUG   ] Got command RPT from MCS: ref #629273
2018-11-26 02:22:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629273  12 58448  8551849 A  ERRORB˜™š'
2018-11-26 02:22:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:22:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:22:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:22:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:22:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:22:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:22:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:22:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:22:55 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-11-26 02:22:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:23:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:23:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:23:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:23:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:23:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:23:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:23:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:23:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:23:55 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-11-26 02:23:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:24:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:24:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 02:24:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:24:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:24:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:24:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:24:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:24:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:24:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:24:55 [DEBUG   ] Finished updating board flags in 1.761 seconds
2018-11-26 02:24:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:25:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 02:25:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 02:25:48 [DEBUG   ] Got command RPT from MCS: ref #629282
2018-11-26 02:25:48 [DEBUG   ] summary = ERROR
2018-11-26 02:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629282  13 58448  8748573 A  ERRORERROR'
2018-11-26 02:25:48 [DEBUG   ] Got command RPT from MCS: ref #629283
2018-11-26 02:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629283  77 58448  8748574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:25:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:25:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:25:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:25:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:25:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:25:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:25:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:25:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:25:55 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-11-26 02:25:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 02:26:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 02:26:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 02:26:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:26:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:26:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:26:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:26:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:26:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:26:55 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-26 02:26:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 02:27:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 02:27:31 [DEBUG   ] Got command RPT from MCS: ref #629299
2018-11-26 02:27:31 [DEBUG   ] summary = ERROR
2018-11-26 02:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629299  13 58448  8851121 A  ERRORERROR'
2018-11-26 02:27:31 [DEBUG   ] Got command RPT from MCS: ref #629300
2018-11-26 02:27:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629300  77 58448  8851325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:27:31 [DEBUG   ] Got command RPT from MCS: ref #629301
2018-11-26 02:27:31 [DEBUG   ] summary = ERROR
2018-11-26 02:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629301  13 58448  8851529 A  ERRORERROR'
2018-11-26 02:27:31 [DEBUG   ] Got command RPT from MCS: ref #629302
2018-11-26 02:27:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629302  77 58448  8851721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:27:31 [DEBUG   ] Got command RPT from MCS: ref #629303
2018-11-26 02:27:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629303  12 58448  8851925 A  ERRORB™™š'
2018-11-26 02:27:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:27:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:27:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:27:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 02:27:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:27:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:27:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:27:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:27:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:27:55 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-11-26 02:27:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:28:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 02:28:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:28:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:28:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:28:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:28:55 [WARNING ] (13, 1, 'bot')
2018-11-26 02:28:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:28:55 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-11-26 02:28:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:29:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 02:29:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 02:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:29:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:29:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:29:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:29:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:29:56 [DEBUG   ] Finished updating board flags in 2.235 seconds
2018-11-26 02:29:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 02:30:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 02:30:37 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-26 02:30:48 [DEBUG   ] Got command RPT from MCS: ref #629312
2018-11-26 02:30:48 [DEBUG   ] summary = ERROR
2018-11-26 02:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629312  13 58448  9048569 A  ERRORERROR'
2018-11-26 02:30:48 [DEBUG   ] Got command RPT from MCS: ref #629313
2018-11-26 02:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629313  77 58448  9048570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:30:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:30:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:30:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:30:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:30:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:30:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:30:56 [DEBUG   ] Finished updating board flags in 2.155 seconds
2018-11-26 02:30:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 02:31:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 02:31:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 02:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:31:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:31:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:31:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:31:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:31:56 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-11-26 02:31:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 02:32:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 02:32:31 [DEBUG   ] Got command RPT from MCS: ref #629331
2018-11-26 02:32:31 [DEBUG   ] summary = ERROR
2018-11-26 02:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629331  13 58448  9151205 A  ERRORERROR'
2018-11-26 02:32:31 [DEBUG   ] Got command RPT from MCS: ref #629332
2018-11-26 02:32:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629332  77 58448  9151409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:32:31 [DEBUG   ] Got command RPT from MCS: ref #629333
2018-11-26 02:32:31 [DEBUG   ] summary = ERROR
2018-11-26 02:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629333  13 58448  9151601 A  ERRORERROR'
2018-11-26 02:32:31 [DEBUG   ] Got command RPT from MCS: ref #629335
2018-11-26 02:32:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629335  77 58448  9151805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:32:32 [DEBUG   ] Got command RPT from MCS: ref #629337
2018-11-26 02:32:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629337  12 58448  9152009 A  ERRORB™™š'
2018-11-26 02:32:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 02:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:32:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:32:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:32:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:32:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:32:56 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-11-26 02:32:58 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-11-26 02:33:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 02:33:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:33:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:33:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:33:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:33:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:33:56 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-26 02:33:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:34:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 02:34:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:34:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:34:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:34:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:34:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:34:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:34:56 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-11-26 02:34:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:35:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 02:35:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 02:35:48 [DEBUG   ] Got command RPT from MCS: ref #629345
2018-11-26 02:35:48 [DEBUG   ] summary = ERROR
2018-11-26 02:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629345  13 58448  9348573 A  ERRORERROR'
2018-11-26 02:35:48 [DEBUG   ] Got command RPT from MCS: ref #629346
2018-11-26 02:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629346  77 58448  9348574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:35:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:35:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:35:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:35:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:35:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:35:56 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-11-26 02:35:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:36:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:36:38 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 02:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 02:36:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:36:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:36:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:36:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:36:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:36:56 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-11-26 02:36:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 02:37:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 02:37:31 [DEBUG   ] Got command RPT from MCS: ref #629366
2018-11-26 02:37:31 [DEBUG   ] summary = ERROR
2018-11-26 02:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629366  13 58448  9451281 A  ERRORERROR'
2018-11-26 02:37:31 [DEBUG   ] Got command RPT from MCS: ref #629367
2018-11-26 02:37:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629367  77 58448  9451485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:37:31 [DEBUG   ] Got command RPT from MCS: ref #629368
2018-11-26 02:37:31 [DEBUG   ] summary = ERROR
2018-11-26 02:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629368  13 58448  9451689 A  ERRORERROR'
2018-11-26 02:37:31 [DEBUG   ] Got command RPT from MCS: ref #629369
2018-11-26 02:37:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629369  77 58448  9451893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:37:32 [DEBUG   ] Got command RPT from MCS: ref #629370
2018-11-26 02:37:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629370  12 58448  9452085 A  ERRORB˜™š'
2018-11-26 02:37:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 02:37:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:37:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:37:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:37:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:37:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:37:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:37:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:37:56 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-26 02:37:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 02:38:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 02:38:39 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2018-11-26 02:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:38:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:38:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:38:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:38:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:38:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:38:56 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-26 02:38:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:39:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 02:39:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:39:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:39:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:39:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:39:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:39:56 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-11-26 02:39:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:40:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:40:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:40:48 [DEBUG   ] Got command RPT from MCS: ref #629375
2018-11-26 02:40:48 [DEBUG   ] summary = ERROR
2018-11-26 02:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629375  13 58448  9648569 A  ERRORERROR'
2018-11-26 02:40:48 [DEBUG   ] Got command RPT from MCS: ref #629376
2018-11-26 02:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629376  77 58448  9648570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:40:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:40:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:40:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:40:56 [WARNING ] (13, 1, 'bot')
2018-11-26 02:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:40:56 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-11-26 02:40:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:41:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:41:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:41:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:41:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:41:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:41:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:41:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:41:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:41:57 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-11-26 02:41:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 02:42:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:42:31 [DEBUG   ] Got command RPT from MCS: ref #629394
2018-11-26 02:42:31 [DEBUG   ] summary = ERROR
2018-11-26 02:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629394  13 58448  9751365 A  ERRORERROR'
2018-11-26 02:42:31 [DEBUG   ] Got command RPT from MCS: ref #629395
2018-11-26 02:42:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629395  77 58448  9751569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:42:31 [DEBUG   ] Got command RPT from MCS: ref #629396
2018-11-26 02:42:31 [DEBUG   ] summary = ERROR
2018-11-26 02:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629396  13 58448  9751765 A  ERRORERROR'
2018-11-26 02:42:31 [DEBUG   ] Got command RPT from MCS: ref #629398
2018-11-26 02:42:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629398  77 58448  9751969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:42:32 [DEBUG   ] Got command RPT from MCS: ref #629399
2018-11-26 02:42:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629399  12 58448  9752173 A  ERRORB˜™š'
2018-11-26 02:42:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 02:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:42:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:42:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:42:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:42:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:42:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:42:57 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-11-26 02:42:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 02:43:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 02:43:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 02:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:43:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:43:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:43:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:43:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:43:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:43:57 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-26 02:43:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 02:44:20 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 02:44:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 02:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:44:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:44:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:44:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:44:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:44:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:44:57 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-11-26 02:45:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 02:45:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 02:45:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 02:45:48 [DEBUG   ] Got command RPT from MCS: ref #629412
2018-11-26 02:45:48 [DEBUG   ] summary = ERROR
2018-11-26 02:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629412  13 58448  9948577 A  ERRORERROR'
2018-11-26 02:45:48 [DEBUG   ] Got command RPT from MCS: ref #629413
2018-11-26 02:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629413  77 58448  9948578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:45:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:45:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:45:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:45:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:45:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:45:57 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-26 02:46:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 02:46:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 02:46:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:46:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:46:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:46:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:46:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:46:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:46:57 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-26 02:47:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 02:47:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:47:31 [DEBUG   ] Got command RPT from MCS: ref #629429
2018-11-26 02:47:31 [DEBUG   ] summary = ERROR
2018-11-26 02:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629429  13 58448 10051449 A  ERRORERROR'
2018-11-26 02:47:31 [DEBUG   ] Got command RPT from MCS: ref #629430
2018-11-26 02:47:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629430  77 58448 10051653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:47:31 [DEBUG   ] Got command RPT from MCS: ref #629431
2018-11-26 02:47:31 [DEBUG   ] summary = ERROR
2018-11-26 02:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629431  13 58448 10051845 A  ERRORERROR'
2018-11-26 02:47:32 [DEBUG   ] Got command RPT from MCS: ref #629432
2018-11-26 02:47:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629432  77 58448 10052049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:47:32 [DEBUG   ] Got command RPT from MCS: ref #629433
2018-11-26 02:47:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629433  12 58448 10052253 A  ERRORB˜™š'
2018-11-26 02:47:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:47:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:47:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:47:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:47:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:47:57 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-26 02:48:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:48:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 02:48:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-26 02:48:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 02:48:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:48:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:48:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:48:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:48:57 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-26 02:49:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 02:49:20 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 02:49:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 02:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:49:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:49:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:49:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:49:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:49:57 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-26 02:50:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 02:50:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 02:50:40 [DEBUG   ] Finished updating ant stats in 0.409 seconds
2018-11-26 02:50:48 [DEBUG   ] Got command RPT from MCS: ref #629438
2018-11-26 02:50:48 [DEBUG   ] summary = ERROR
2018-11-26 02:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629438  13 58448 10248581 A  ERRORERROR'
2018-11-26 02:50:48 [DEBUG   ] Got command RPT from MCS: ref #629439
2018-11-26 02:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629439  77 58448 10248582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:50:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:50:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:50:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:50:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:50:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:50:57 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-26 02:51:00 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-26 02:51:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 02:51:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 02:51:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:51:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:51:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:51:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:51:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:51:57 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-26 02:52:01 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 02:52:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:52:31 [DEBUG   ] Got command RPT from MCS: ref #629461
2018-11-26 02:52:31 [DEBUG   ] summary = ERROR
2018-11-26 02:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629461  13 58448 10351525 A  ERRORERROR'
2018-11-26 02:52:31 [DEBUG   ] Got command RPT from MCS: ref #629462
2018-11-26 02:52:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629462  77 58448 10351729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:52:31 [DEBUG   ] Got command RPT from MCS: ref #629463
2018-11-26 02:52:31 [DEBUG   ] summary = ERROR
2018-11-26 02:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629463  13 58448 10351933 A  ERRORERROR'
2018-11-26 02:52:32 [DEBUG   ] Got command RPT from MCS: ref #629465
2018-11-26 02:52:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629465  77 58448 10352125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:52:32 [DEBUG   ] Got command RPT from MCS: ref #629466
2018-11-26 02:52:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629466  12 58448 10352329 A  ERRORB˜™š'
2018-11-26 02:52:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:52:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:52:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:52:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:52:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:52:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:52:57 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-26 02:53:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 02:53:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 02:53:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 02:53:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:53:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:53:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:53:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:53:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:53:57 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-26 02:54:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 02:54:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 02:54:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 02:54:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 02:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:54:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:54:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:54:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:54:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:54:57 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-26 02:55:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-26 02:55:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 02:55:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 02:55:48 [DEBUG   ] Got command RPT from MCS: ref #629475
2018-11-26 02:55:48 [DEBUG   ] summary = ERROR
2018-11-26 02:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629475  13 58448 10548577 A  ERRORERROR'
2018-11-26 02:55:48 [DEBUG   ] Got command RPT from MCS: ref #629476
2018-11-26 02:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629476  77 58448 10548578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:55:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:55:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:55:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:55:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:55:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:55:57 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-26 02:56:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 02:56:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 02:56:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 02:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:56:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:56:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:56:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:56:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:56:57 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-26 02:57:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 02:57:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 02:57:31 [DEBUG   ] Got command RPT from MCS: ref #629492
2018-11-26 02:57:31 [DEBUG   ] summary = ERROR
2018-11-26 02:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629492  13 58448 10651609 A  ERRORERROR'
2018-11-26 02:57:31 [DEBUG   ] Got command RPT from MCS: ref #629493
2018-11-26 02:57:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629493  77 58448 10651813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:57:32 [DEBUG   ] Got command RPT from MCS: ref #629494
2018-11-26 02:57:32 [DEBUG   ] summary = ERROR
2018-11-26 02:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629494  13 58448 10652006 A  ERRORERROR'
2018-11-26 02:57:32 [DEBUG   ] Got command RPT from MCS: ref #629495
2018-11-26 02:57:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 02:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629495  77 58448 10652209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 02:57:32 [DEBUG   ] Got command RPT from MCS: ref #629496
2018-11-26 02:57:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 02:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629496  12 58448 10652413 A  ERRORB˜™š'
2018-11-26 02:57:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 02:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:57:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-26 02:57:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:57:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:57:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:57:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:57:57 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-11-26 02:58:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 02:58:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 02:58:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 02:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:58:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 02:58:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:58:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:58:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:58:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:58:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:58:57 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-26 02:59:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 02:59:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 02:59:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 02:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 02:59:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:59:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:59:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:59:57 [WARNING ] (13, 1, 'bot')
2018-11-26 02:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 02:59:57 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-26 03:00:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 03:00:22 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 03:00:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 03:00:48 [DEBUG   ] Got command RPT from MCS: ref #629505
2018-11-26 03:00:48 [DEBUG   ] summary = ERROR
2018-11-26 03:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629505  13 58448 10848573 A  ERRORERROR'
2018-11-26 03:00:48 [DEBUG   ] Got command RPT from MCS: ref #629506
2018-11-26 03:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629506  77 58448 10848574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:00:57 [WARNING ] (13, 1, 'bot')
2018-11-26 03:00:57 [WARNING ] (13, 1, 'bot')
2018-11-26 03:00:57 [WARNING ] (13, 1, 'bot')
2018-11-26 03:00:57 [WARNING ] (13, 1, 'bot')
2018-11-26 03:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:00:57 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-11-26 03:01:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 03:01:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 03:01:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 03:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:01:57 [WARNING ] (13, 1, 'bot')
2018-11-26 03:01:57 [WARNING ] (13, 1, 'bot')
2018-11-26 03:01:57 [WARNING ] (13, 1, 'bot')
2018-11-26 03:01:57 [WARNING ] (13, 1, 'bot')
2018-11-26 03:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:01:57 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-11-26 03:02:02 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-26 03:02:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 03:02:31 [DEBUG   ] Got command RPT from MCS: ref #629524
2018-11-26 03:02:31 [DEBUG   ] summary = ERROR
2018-11-26 03:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629524  13 58448 10951689 A  ERRORERROR'
2018-11-26 03:02:31 [DEBUG   ] Got command RPT from MCS: ref #629525
2018-11-26 03:02:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629525  77 58448 10951897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:02:32 [DEBUG   ] Got command RPT from MCS: ref #629526
2018-11-26 03:02:32 [DEBUG   ] summary = ERROR
2018-11-26 03:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629526  13 58448 10952085 A  ERRORERROR'
2018-11-26 03:02:32 [DEBUG   ] Got command RPT from MCS: ref #629528
2018-11-26 03:02:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629528  77 58448 10952289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:02:32 [DEBUG   ] Got command RPT from MCS: ref #629529
2018-11-26 03:02:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629529  12 58448 10952493 A  ERRORB˜™š'
2018-11-26 03:02:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 03:02:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:02:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:02:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:02:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:02:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:02:58 [DEBUG   ] Finished updating board flags in 2.206 seconds
2018-11-26 03:03:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 03:03:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:03:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:03:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:03:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:03:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:03:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:03:58 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-11-26 03:04:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:04:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 03:04:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 03:04:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:04:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:04:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:04:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:04:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:04:58 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-11-26 03:05:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 03:05:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 03:05:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 03:05:48 [DEBUG   ] Got command RPT from MCS: ref #629538
2018-11-26 03:05:48 [DEBUG   ] summary = ERROR
2018-11-26 03:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629538  13 58448 11148585 A  ERRORERROR'
2018-11-26 03:05:48 [DEBUG   ] Got command RPT from MCS: ref #629539
2018-11-26 03:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629539  77 58448 11148586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:05:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:05:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:05:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:05:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:05:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:05:58 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-11-26 03:06:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 03:06:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 03:06:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 03:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:06:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:06:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:06:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:06:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:06:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:06:58 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-26 03:07:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 03:07:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 03:07:31 [DEBUG   ] Got command RPT from MCS: ref #629559
2018-11-26 03:07:31 [DEBUG   ] summary = ERROR
2018-11-26 03:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629559  13 58448 11251773 A  ERRORERROR'
2018-11-26 03:07:31 [DEBUG   ] Got command RPT from MCS: ref #629560
2018-11-26 03:07:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629560  77 58448 11251965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:07:32 [DEBUG   ] Got command RPT from MCS: ref #629561
2018-11-26 03:07:32 [DEBUG   ] summary = ERROR
2018-11-26 03:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629561  13 58448 11252169 A  ERRORERROR'
2018-11-26 03:07:32 [DEBUG   ] Got command RPT from MCS: ref #629562
2018-11-26 03:07:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629562  77 58448 11252373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:07:32 [DEBUG   ] Got command RPT from MCS: ref #629563
2018-11-26 03:07:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629563  12 58448 11252577 A  ERRORB—™š'
2018-11-26 03:07:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 03:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:07:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:07:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:07:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:07:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:07:58 [DEBUG   ] Finished updating board flags in 1.963 seconds
2018-11-26 03:08:04 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 03:08:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 03:08:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 03:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:08:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:08:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:08:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:08:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:08:58 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-26 03:09:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 03:09:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 03:09:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:09:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:09:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:09:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:09:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:09:58 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-11-26 03:10:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:10:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:10:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 03:10:48 [DEBUG   ] Got command RPT from MCS: ref #629568
2018-11-26 03:10:48 [DEBUG   ] summary = ERROR
2018-11-26 03:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629568  13 58448 11448581 A  ERRORERROR'
2018-11-26 03:10:48 [DEBUG   ] Got command RPT from MCS: ref #629569
2018-11-26 03:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629569  77 58448 11448582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:10:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 03:10:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:10:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:10:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:10:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:10:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:10:58 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-26 03:11:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 03:11:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 03:11:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 03:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:11:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:11:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:11:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:11:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:11:58 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-26 03:12:04 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-11-26 03:12:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 03:12:31 [DEBUG   ] Got command RPT from MCS: ref #629587
2018-11-26 03:12:31 [DEBUG   ] summary = ERROR
2018-11-26 03:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629587  13 58448 11551853 A  ERRORERROR'
2018-11-26 03:12:32 [DEBUG   ] Got command RPT from MCS: ref #629588
2018-11-26 03:12:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629588  77 58448 11552045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:12:32 [DEBUG   ] Got command RPT from MCS: ref #629589
2018-11-26 03:12:32 [DEBUG   ] summary = ERROR
2018-11-26 03:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629589  13 58448 11552249 A  ERRORERROR'
2018-11-26 03:12:32 [DEBUG   ] Got command RPT from MCS: ref #629591
2018-11-26 03:12:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629591  77 58448 11552453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:12:32 [DEBUG   ] Got command RPT from MCS: ref #629592
2018-11-26 03:12:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629592  12 58448 11552657 A  ERRORB˜™š'
2018-11-26 03:12:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 03:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:12:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:12:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:12:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:12:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:12:58 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-11-26 03:13:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 03:13:25 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 03:13:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 03:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:13:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:13:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:13:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:13:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:13:58 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-11-26 03:14:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 03:14:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 03:14:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 03:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:14:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:14:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:14:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:14:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:14:58 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-26 03:15:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 03:15:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:15:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 03:15:48 [DEBUG   ] Got command RPT from MCS: ref #629605
2018-11-26 03:15:48 [DEBUG   ] summary = ERROR
2018-11-26 03:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629605  13 58448 11748585 A  ERRORERROR'
2018-11-26 03:15:48 [DEBUG   ] Got command RPT from MCS: ref #629606
2018-11-26 03:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629606  77 58448 11748586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:15:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:15:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:15:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:15:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:15:58 [WARNING ] (13, 1, 'bot')
2018-11-26 03:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:15:58 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-11-26 03:16:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 03:16:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 03:16:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 03:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 03:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:16:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:16:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:16:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:16:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:16:59 [DEBUG   ] Finished updating board flags in 2.054 seconds
2018-11-26 03:17:05 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-26 03:17:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 03:17:31 [DEBUG   ] Got command RPT from MCS: ref #629622
2018-11-26 03:17:31 [DEBUG   ] summary = ERROR
2018-11-26 03:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629622  13 58448 11851933 A  ERRORERROR'
2018-11-26 03:17:32 [DEBUG   ] Got command RPT from MCS: ref #629623
2018-11-26 03:17:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629623  77 58448 11852137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:17:32 [DEBUG   ] Got command RPT from MCS: ref #629624
2018-11-26 03:17:32 [DEBUG   ] summary = ERROR
2018-11-26 03:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629624  13 58448 11852329 A  ERRORERROR'
2018-11-26 03:17:32 [DEBUG   ] Got command RPT from MCS: ref #629625
2018-11-26 03:17:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629625  77 58448 11852533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:17:32 [DEBUG   ] Got command RPT from MCS: ref #629626
2018-11-26 03:17:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629626  12 58448 11852737 A  ERRORB˜™š'
2018-11-26 03:17:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 03:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 03:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:17:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:17:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:17:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:17:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:17:59 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-26 03:18:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 03:18:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 03:18:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 03:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:18:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:18:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:18:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:18:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:18:59 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-11-26 03:19:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 03:19:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 03:19:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 03:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:19:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 03:19:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:19:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:19:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:19:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:19:59 [DEBUG   ] Finished updating board flags in 1.849 seconds
2018-11-26 03:20:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 03:20:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 03:20:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 03:20:48 [DEBUG   ] Got command RPT from MCS: ref #629631
2018-11-26 03:20:48 [DEBUG   ] summary = ERROR
2018-11-26 03:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629631  13 58448 12048585 A  ERRORERROR'
2018-11-26 03:20:48 [DEBUG   ] Got command RPT from MCS: ref #629632
2018-11-26 03:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629632  77 58448 12048586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:20:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:20:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:20:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:20:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:20:59 [DEBUG   ] Finished updating board flags in 1.752 seconds
2018-11-26 03:21:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:21:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 03:21:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 03:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 03:21:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:21:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:21:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:21:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:21:59 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-11-26 03:22:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 03:22:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 03:22:32 [DEBUG   ] Got command RPT from MCS: ref #629654
2018-11-26 03:22:32 [DEBUG   ] summary = ERROR
2018-11-26 03:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629654  13 58448 12152005 A  ERRORERROR'
2018-11-26 03:22:32 [DEBUG   ] Got command RPT from MCS: ref #629655
2018-11-26 03:22:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629655  77 58448 12152209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:22:32 [DEBUG   ] Got command RPT from MCS: ref #629656
2018-11-26 03:22:32 [DEBUG   ] summary = ERROR
2018-11-26 03:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629656  13 58448 12152413 A  ERRORERROR'
2018-11-26 03:22:32 [DEBUG   ] Got command RPT from MCS: ref #629658
2018-11-26 03:22:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629658  77 58448 12152617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:22:32 [DEBUG   ] Got command RPT from MCS: ref #629660
2018-11-26 03:22:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629660  12 58448 12152809 A  ERRORB™™š'
2018-11-26 03:22:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 03:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:22:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 03:22:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:22:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:22:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:22:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:22:59 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-26 03:23:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 03:23:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 03:23:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 03:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:23:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:23:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:23:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:23:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:23:59 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-11-26 03:24:07 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-26 03:24:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 03:24:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 03:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:24:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:24:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:24:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:24:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:24:59 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-26 03:25:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 03:25:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 03:25:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:25:48 [DEBUG   ] Got command RPT from MCS: ref #629668
2018-11-26 03:25:48 [DEBUG   ] summary = ERROR
2018-11-26 03:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629668  13 58448 12348589 A  ERRORERROR'
2018-11-26 03:25:48 [DEBUG   ] Got command RPT from MCS: ref #629669
2018-11-26 03:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629669  77 58448 12348590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 03:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:25:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:25:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:25:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:25:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:25:59 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-26 03:26:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:26:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:26:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 03:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:26:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:26:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:26:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:26:59 [WARNING ] (13, 1, 'bot')
2018-11-26 03:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:26:59 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-11-26 03:27:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 03:27:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 03:27:32 [DEBUG   ] Got command RPT from MCS: ref #629685
2018-11-26 03:27:32 [DEBUG   ] summary = ERROR
2018-11-26 03:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629685  13 58448 12452093 A  ERRORERROR'
2018-11-26 03:27:32 [DEBUG   ] Got command RPT from MCS: ref #629686
2018-11-26 03:27:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629686  77 58448 12452297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:27:32 [DEBUG   ] Got command RPT from MCS: ref #629687
2018-11-26 03:27:32 [DEBUG   ] summary = ERROR
2018-11-26 03:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629687  13 58448 12452489 A  ERRORERROR'
2018-11-26 03:27:32 [DEBUG   ] Got command RPT from MCS: ref #629688
2018-11-26 03:27:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629688  77 58448 12452693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:27:32 [DEBUG   ] Got command RPT from MCS: ref #629689
2018-11-26 03:27:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629689  12 58448 12452897 A  ERRORB—™š'
2018-11-26 03:27:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 03:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 03:28:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:28:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:28:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:28:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:28:00 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-11-26 03:28:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 03:28:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 03:28:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 03:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:29:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:29:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:29:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:29:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:29:00 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-11-26 03:29:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 03:29:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 03:29:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 03:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:30:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 03:30:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:30:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:30:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:30:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:30:00 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-26 03:30:07 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-26 03:30:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 03:30:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 03:30:48 [DEBUG   ] Got command RPT from MCS: ref #629698
2018-11-26 03:30:48 [DEBUG   ] summary = ERROR
2018-11-26 03:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629698  13 58448 12648581 A  ERRORERROR'
2018-11-26 03:30:48 [DEBUG   ] Got command RPT from MCS: ref #629699
2018-11-26 03:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629699  77 58448 12648582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-26 03:31:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:31:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:31:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:31:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:31:00 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-11-26 03:31:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 03:31:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 03:31:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 03:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:32:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 03:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 03:32:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:32:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:32:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:32:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:32:00 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-26 03:32:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:32:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:32:32 [DEBUG   ] Got command RPT from MCS: ref #629717
2018-11-26 03:32:32 [DEBUG   ] summary = ERROR
2018-11-26 03:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629717  13 58448 12752165 A  ERRORERROR'
2018-11-26 03:32:32 [DEBUG   ] Got command RPT from MCS: ref #629718
2018-11-26 03:32:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629718  77 58448 12752369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:32:32 [DEBUG   ] Got command RPT from MCS: ref #629719
2018-11-26 03:32:32 [DEBUG   ] summary = ERROR
2018-11-26 03:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629719  13 58448 12752573 A  ERRORERROR'
2018-11-26 03:32:32 [DEBUG   ] Got command RPT from MCS: ref #629721
2018-11-26 03:32:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629721  77 58448 12752765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:32:32 [DEBUG   ] Got command RPT from MCS: ref #629722
2018-11-26 03:32:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629722  12 58448 12752969 A  ERRORB˜™š'
2018-11-26 03:32:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 03:32:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:33:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:33:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:33:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:33:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:33:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:33:00 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-26 03:33:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 03:33:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 03:33:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 03:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:34:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:34:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:34:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:34:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:34:00 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-11-26 03:34:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 03:34:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 03:34:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 03:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:35:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-26 03:35:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:35:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:35:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:35:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:35:00 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-26 03:35:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 03:35:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 03:35:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 03:35:48 [DEBUG   ] Got command RPT from MCS: ref #629731
2018-11-26 03:35:48 [DEBUG   ] summary = ERROR
2018-11-26 03:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629731  13 58448 12948585 A  ERRORERROR'
2018-11-26 03:35:48 [DEBUG   ] Got command RPT from MCS: ref #629732
2018-11-26 03:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629732  77 58448 12948586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:36:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:36:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:36:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:36:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:36:00 [WARNING ] (13, 1, 'bot')
2018-11-26 03:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:36:00 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-26 03:36:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 03:36:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 03:36:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 03:37:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:37:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:37:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:37:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:37:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:37:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:37:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:37:01 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-11-26 03:37:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 03:37:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 03:37:32 [DEBUG   ] Got command RPT from MCS: ref #629752
2018-11-26 03:37:32 [DEBUG   ] summary = ERROR
2018-11-26 03:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629752  13 58448 13052249 A  ERRORERROR'
2018-11-26 03:37:32 [DEBUG   ] Got command RPT from MCS: ref #629753
2018-11-26 03:37:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629753  77 58448 13052453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:37:32 [DEBUG   ] Got command RPT from MCS: ref #629754
2018-11-26 03:37:32 [DEBUG   ] summary = ERROR
2018-11-26 03:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629754  13 58448 13052645 A  ERRORERROR'
2018-11-26 03:37:32 [DEBUG   ] Got command RPT from MCS: ref #629755
2018-11-26 03:37:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629755  77 58448 13052849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:37:33 [DEBUG   ] Got command RPT from MCS: ref #629756
2018-11-26 03:37:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629756  12 58448 13053053 A  ERRORB˜™š'
2018-11-26 03:37:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 03:38:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:38:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:38:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:38:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:38:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:38:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:38:01 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-26 03:38:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 03:38:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:38:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:39:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:39:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:39:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:39:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:39:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:39:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:39:01 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-26 03:39:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:39:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 03:39:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 03:40:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:40:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:40:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:40:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:40:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:40:01 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-26 03:40:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 03:40:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 03:40:48 [DEBUG   ] Got command RPT from MCS: ref #629761
2018-11-26 03:40:48 [DEBUG   ] summary = ERROR
2018-11-26 03:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629761  13 58448 13248586 A  ERRORERROR'
2018-11-26 03:40:48 [DEBUG   ] Got command RPT from MCS: ref #629762
2018-11-26 03:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629762  77 58448 13248586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:40:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 03:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:41:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:41:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:41:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:41:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:41:01 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-26 03:41:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 03:41:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 03:41:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 03:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 03:42:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:42:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:42:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:42:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:42:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:42:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:42:01 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-11-26 03:42:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 03:42:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 03:42:32 [DEBUG   ] Got command RPT from MCS: ref #629780
2018-11-26 03:42:32 [DEBUG   ] summary = ERROR
2018-11-26 03:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629780  13 58448 13352321 A  ERRORERROR'
2018-11-26 03:42:32 [DEBUG   ] Got command RPT from MCS: ref #629781
2018-11-26 03:42:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629781  77 58448 13352525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:42:32 [DEBUG   ] Got command RPT from MCS: ref #629782
2018-11-26 03:42:32 [DEBUG   ] summary = ERROR
2018-11-26 03:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629782  13 58448 13352730 A  ERRORERROR'
2018-11-26 03:42:32 [DEBUG   ] Got command RPT from MCS: ref #629784
2018-11-26 03:42:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629784  77 58448 13352921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:42:33 [DEBUG   ] Got command RPT from MCS: ref #629785
2018-11-26 03:42:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629785  12 58448 13353125 A  ERRORB˜™š'
2018-11-26 03:42:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 03:43:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:43:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:43:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:43:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:43:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:43:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:43:01 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-26 03:43:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 03:43:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 03:43:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 03:44:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:44:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:44:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:44:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:44:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:44:01 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-26 03:44:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 03:44:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:44:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:45:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:45:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 03:45:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:45:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:45:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:45:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:45:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:45:01 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-26 03:45:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 03:45:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 03:45:48 [DEBUG   ] Got command RPT from MCS: ref #629798
2018-11-26 03:45:48 [DEBUG   ] summary = ERROR
2018-11-26 03:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629798  13 58448 13548581 A  ERRORERROR'
2018-11-26 03:45:48 [DEBUG   ] Got command RPT from MCS: ref #629799
2018-11-26 03:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629799  77 58448 13548582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:45:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 03:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:46:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:46:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:46:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:46:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:46:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:46:01 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-11-26 03:46:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 03:46:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 03:46:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 03:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:47:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:47:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:47:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:47:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:47:01 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-26 03:47:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 03:47:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 03:47:32 [DEBUG   ] Got command RPT from MCS: ref #629815
2018-11-26 03:47:32 [DEBUG   ] summary = ERROR
2018-11-26 03:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629815  13 58448 13652405 A  ERRORERROR'
2018-11-26 03:47:32 [DEBUG   ] Got command RPT from MCS: ref #629816
2018-11-26 03:47:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629816  77 58448 13652609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:47:32 [DEBUG   ] Got command RPT from MCS: ref #629817
2018-11-26 03:47:32 [DEBUG   ] summary = ERROR
2018-11-26 03:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629817  13 58448 13652801 A  ERRORERROR'
2018-11-26 03:47:33 [DEBUG   ] Got command RPT from MCS: ref #629818
2018-11-26 03:47:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629818  77 58448 13653005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:47:33 [DEBUG   ] Got command RPT from MCS: ref #629819
2018-11-26 03:47:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629819  12 58448 13653209 A  ERRORB˜™š'
2018-11-26 03:47:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 03:48:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:48:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:48:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:48:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:48:01 [WARNING ] (13, 1, 'bot')
2018-11-26 03:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:48:01 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-11-26 03:48:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 03:48:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 03:48:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 03:49:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:49:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:49:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:49:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:49:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:49:02 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-11-26 03:49:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 03:49:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:49:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 03:50:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:50:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:50:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:50:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:50:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:50:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:50:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:50:02 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-11-26 03:50:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 03:50:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 03:50:48 [DEBUG   ] Got command RPT from MCS: ref #629824
2018-11-26 03:50:48 [DEBUG   ] summary = ERROR
2018-11-26 03:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629824  13 58448 13848593 A  ERRORERROR'
2018-11-26 03:50:48 [DEBUG   ] Got command RPT from MCS: ref #629825
2018-11-26 03:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629825  77 58448 13848594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:50:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 03:51:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:51:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:51:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:51:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:51:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:51:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:51:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:51:02 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-26 03:51:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 03:51:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 03:51:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 03:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:52:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:52:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:52:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:52:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:52:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:52:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:52:02 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-26 03:52:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 03:52:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 03:52:32 [DEBUG   ] Got command RPT from MCS: ref #629847
2018-11-26 03:52:32 [DEBUG   ] summary = ERROR
2018-11-26 03:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629847  13 58448 13952489 A  ERRORERROR'
2018-11-26 03:52:32 [DEBUG   ] Got command RPT from MCS: ref #629848
2018-11-26 03:52:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629848  77 58448 13952681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:52:32 [DEBUG   ] Got command RPT from MCS: ref #629849
2018-11-26 03:52:32 [DEBUG   ] summary = ERROR
2018-11-26 03:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629849  13 58448 13952885 A  ERRORERROR'
2018-11-26 03:52:33 [DEBUG   ] Got command RPT from MCS: ref #629851
2018-11-26 03:52:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629851  77 58448 13953089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:52:33 [DEBUG   ] Got command RPT from MCS: ref #629852
2018-11-26 03:52:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629852  12 58448 13953281 A  ERRORB˜™š'
2018-11-26 03:52:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 03:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:53:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:53:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 03:53:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:53:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:53:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:53:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:53:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:53:02 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-11-26 03:53:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 03:53:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 03:53:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 03:54:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 03:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:54:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:54:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:54:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:54:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:54:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:54:02 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-11-26 03:54:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 03:54:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:54:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 03:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:55:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:55:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:55:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:55:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:55:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:55:02 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-11-26 03:55:12 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2018-11-26 03:55:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 03:55:48 [DEBUG   ] Got command RPT from MCS: ref #629861
2018-11-26 03:55:48 [DEBUG   ] summary = ERROR
2018-11-26 03:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629861  13 58448 14148585 A  ERRORERROR'
2018-11-26 03:55:48 [DEBUG   ] Got command RPT from MCS: ref #629862
2018-11-26 03:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629862  77 58448 14148586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:55:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 03:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:56:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:56:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:56:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:56:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:56:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:56:02 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-26 03:56:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 03:56:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 03:56:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 03:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:57:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:57:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:57:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:57:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:57:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:57:02 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-11-26 03:57:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 03:57:32 [DEBUG   ] Got command RPT from MCS: ref #629878
2018-11-26 03:57:32 [DEBUG   ] summary = ERROR
2018-11-26 03:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629878  13 58448 14252565 A  ERRORERROR'
2018-11-26 03:57:32 [DEBUG   ] Got command RPT from MCS: ref #629879
2018-11-26 03:57:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629879  77 58448 14252769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:57:32 [DEBUG   ] Got command RPT from MCS: ref #629880
2018-11-26 03:57:32 [DEBUG   ] summary = ERROR
2018-11-26 03:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629880  13 58448 14252961 A  ERRORERROR'
2018-11-26 03:57:33 [DEBUG   ] Got command RPT from MCS: ref #629881
2018-11-26 03:57:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 03:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629881  77 58448 14253165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 03:57:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 03:57:33 [DEBUG   ] Got command RPT from MCS: ref #629882
2018-11-26 03:57:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 03:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629882  12 58448 14253369 A  ERRORB™™š'
2018-11-26 03:57:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 03:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:58:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:58:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:58:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:58:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:58:02 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-11-26 03:58:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 03:58:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 03:58:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 03:59:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 03:59:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:59:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:59:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:59:02 [WARNING ] (13, 1, 'bot')
2018-11-26 03:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 03:59:02 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-11-26 03:59:13 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-11-26 03:59:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 03:59:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 04:00:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:00:02 [WARNING ] (13, 1, 'bot')
2018-11-26 04:00:02 [WARNING ] (13, 1, 'bot')
2018-11-26 04:00:02 [WARNING ] (13, 1, 'bot')
2018-11-26 04:00:02 [WARNING ] (13, 1, 'bot')
2018-11-26 04:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:00:02 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-11-26 04:00:13 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-11-26 04:00:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 04:00:48 [DEBUG   ] Got command RPT from MCS: ref #629891
2018-11-26 04:00:48 [DEBUG   ] summary = ERROR
2018-11-26 04:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629891  13 58448 14448593 A  ERRORERROR'
2018-11-26 04:00:48 [DEBUG   ] Got command RPT from MCS: ref #629892
2018-11-26 04:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629892  77 58448 14448594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:00:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:01:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:01:02 [WARNING ] (13, 1, 'bot')
2018-11-26 04:01:02 [WARNING ] (13, 1, 'bot')
2018-11-26 04:01:02 [WARNING ] (13, 1, 'bot')
2018-11-26 04:01:02 [WARNING ] (13, 1, 'bot')
2018-11-26 04:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:01:02 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-11-26 04:01:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:01:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 04:01:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 04:02:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:02:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:02:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:02:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:02:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:02:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:02:03 [DEBUG   ] Finished updating board flags in 2.220 seconds
2018-11-26 04:02:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-26 04:02:32 [DEBUG   ] Got command RPT from MCS: ref #629910
2018-11-26 04:02:32 [DEBUG   ] summary = ERROR
2018-11-26 04:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629910  13 58448 14552645 A  ERRORERROR'
2018-11-26 04:02:32 [DEBUG   ] Got command RPT from MCS: ref #629911
2018-11-26 04:02:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629911  77 58448 14552849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:02:33 [DEBUG   ] Got command RPT from MCS: ref #629912
2018-11-26 04:02:33 [DEBUG   ] summary = ERROR
2018-11-26 04:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629912  13 58448 14553041 A  ERRORERROR'
2018-11-26 04:02:33 [DEBUG   ] Got command RPT from MCS: ref #629914
2018-11-26 04:02:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629914  77 58448 14553249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:02:33 [DEBUG   ] Got command RPT from MCS: ref #629915
2018-11-26 04:02:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629915  12 58448 14553441 A  ERRORB˜™š'
2018-11-26 04:02:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 04:02:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 04:03:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:03:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:03:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:03:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:03:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:03:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:03:03 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-11-26 04:03:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 04:03:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 04:03:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:04:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:04:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 04:04:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:04:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:04:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:04:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:04:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:04:03 [DEBUG   ] Finished updating board flags in 2.124 seconds
2018-11-26 04:04:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:04:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:04:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 04:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:05:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:05:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:05:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:05:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:05:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:05:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:05:03 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-11-26 04:05:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 04:05:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 04:05:48 [DEBUG   ] Got command RPT from MCS: ref #629924
2018-11-26 04:05:48 [DEBUG   ] summary = ERROR
2018-11-26 04:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629924  13 58448 14748593 A  ERRORERROR'
2018-11-26 04:05:48 [DEBUG   ] Got command RPT from MCS: ref #629925
2018-11-26 04:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629925  77 58448 14748594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:05:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 04:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 04:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:06:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:06:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:06:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:06:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:06:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:06:03 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-26 04:06:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 04:06:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 04:06:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:07:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:07:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:07:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:07:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:07:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:07:03 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-11-26 04:07:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 04:07:32 [DEBUG   ] Got command RPT from MCS: ref #629945
2018-11-26 04:07:32 [DEBUG   ] summary = ERROR
2018-11-26 04:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629945  13 58448 14852725 A  ERRORERROR'
2018-11-26 04:07:32 [DEBUG   ] Got command RPT from MCS: ref #629946
2018-11-26 04:07:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629946  77 58448 14852929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:07:33 [DEBUG   ] Got command RPT from MCS: ref #629947
2018-11-26 04:07:33 [DEBUG   ] summary = ERROR
2018-11-26 04:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629947  13 58448 14853121 A  ERRORERROR'
2018-11-26 04:07:33 [DEBUG   ] Got command RPT from MCS: ref #629948
2018-11-26 04:07:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629948  77 58448 14853325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:07:33 [DEBUG   ] Got command RPT from MCS: ref #629949
2018-11-26 04:07:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629949  12 58448 14853529 A  ERRORB˜™š'
2018-11-26 04:07:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:07:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 04:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:08:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:08:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:08:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:08:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:08:03 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-11-26 04:08:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 04:08:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 04:08:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 04:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:09:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:09:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:09:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:09:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:09:03 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-11-26 04:09:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 04:09:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 04:09:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 04:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:10:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:10:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:10:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:10:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:10:03 [DEBUG   ] Finished updating board flags in 1.665 seconds
2018-11-26 04:10:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:10:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 04:10:48 [DEBUG   ] Got command RPT from MCS: ref #629954
2018-11-26 04:10:48 [DEBUG   ] summary = ERROR
2018-11-26 04:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629954  13 58448 15048589 A  ERRORERROR'
2018-11-26 04:10:48 [DEBUG   ] Got command RPT from MCS: ref #629955
2018-11-26 04:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629955  77 58448 15048590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:10:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:11:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:11:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:11:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:11:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:11:03 [DEBUG   ] Finished updating board flags in 1.536 seconds
2018-11-26 04:11:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 04:11:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 04:11:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 04:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:12:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:12:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:12:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:12:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:12:03 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-26 04:12:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 04:12:32 [DEBUG   ] Got command RPT from MCS: ref #629973
2018-11-26 04:12:32 [DEBUG   ] summary = ERROR
2018-11-26 04:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629973  13 58448 15152801 A  ERRORERROR'
2018-11-26 04:12:33 [DEBUG   ] Got command RPT from MCS: ref #629974
2018-11-26 04:12:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629974  77 58448 15153005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:12:33 [DEBUG   ] Got command RPT from MCS: ref #629975
2018-11-26 04:12:33 [DEBUG   ] summary = ERROR
2018-11-26 04:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629975  13 58448 15153209 A  ERRORERROR'
2018-11-26 04:12:33 [DEBUG   ] Got command RPT from MCS: ref #629976
2018-11-26 04:12:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629976  77 58448 15153401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:12:33 [DEBUG   ] Got command RPT from MCS: ref #629978
2018-11-26 04:12:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629978  12 58448 15153605 A  ERRORB—™š'
2018-11-26 04:12:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 04:12:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 04:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:13:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:13:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:13:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:13:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:13:03 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-26 04:13:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:13:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:13:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:14:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:14:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:14:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:14:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:14:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:14:03 [WARNING ] (13, 1, 'bot')
2018-11-26 04:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:14:03 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-11-26 04:14:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 04:14:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 04:14:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 04:15:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:15:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:15:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:15:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:15:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:15:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:15:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:15:04 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-11-26 04:15:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:15:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:15:48 [DEBUG   ] Got command RPT from MCS: ref #629991
2018-11-26 04:15:48 [DEBUG   ] summary = ERROR
2018-11-26 04:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629991  13 58448 15348593 A  ERRORERROR'
2018-11-26 04:15:48 [DEBUG   ] Got command RPT from MCS: ref #629992
2018-11-26 04:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   629992  77 58448 15348594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:15:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:16:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:16:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:16:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:16:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:16:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:16:04 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-11-26 04:16:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 04:16:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 04:16:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 04:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:17:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:17:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:17:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:17:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:17:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:17:04 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-11-26 04:17:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 04:17:32 [DEBUG   ] Got command RPT from MCS: ref #630008
2018-11-26 04:17:32 [DEBUG   ] summary = ERROR
2018-11-26 04:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630008  13 58448 15452881 A  ERRORERROR'
2018-11-26 04:17:33 [DEBUG   ] Got command RPT from MCS: ref #630009
2018-11-26 04:17:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630009  77 58448 15453085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:17:33 [DEBUG   ] Got command RPT from MCS: ref #630010
2018-11-26 04:17:33 [DEBUG   ] summary = ERROR
2018-11-26 04:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630010  13 58448 15453289 A  ERRORERROR'
2018-11-26 04:17:33 [DEBUG   ] Got command RPT from MCS: ref #630011
2018-11-26 04:17:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630011  77 58448 15453481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:17:33 [DEBUG   ] Got command RPT from MCS: ref #630012
2018-11-26 04:17:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630012  12 58448 15453685 A  ERRORB˜™š'
2018-11-26 04:17:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 04:17:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 04:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:18:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:18:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:18:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:18:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:18:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:18:04 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-11-26 04:18:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:18:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 04:18:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:19:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:19:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:19:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:19:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:19:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:19:04 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-11-26 04:19:16 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2018-11-26 04:19:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 04:19:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 04:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:20:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:20:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:20:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:20:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:20:04 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-11-26 04:20:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 04:20:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 04:20:48 [DEBUG   ] Got command RPT from MCS: ref #630017
2018-11-26 04:20:48 [DEBUG   ] summary = ERROR
2018-11-26 04:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630017  13 58448 15648589 A  ERRORERROR'
2018-11-26 04:20:48 [DEBUG   ] Got command RPT from MCS: ref #630018
2018-11-26 04:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630018  77 58448 15648590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:20:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 04:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:21:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:21:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:21:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:21:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:21:04 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-26 04:21:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 04:21:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-26 04:21:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 04:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:22:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:22:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:22:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:22:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:22:04 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-26 04:22:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 04:22:32 [DEBUG   ] Got command RPT from MCS: ref #630040
2018-11-26 04:22:32 [DEBUG   ] summary = ERROR
2018-11-26 04:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630040  13 58448 15752969 A  ERRORERROR'
2018-11-26 04:22:33 [DEBUG   ] Got command RPT from MCS: ref #630041
2018-11-26 04:22:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630041  77 58448 15753161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:22:33 [DEBUG   ] Got command RPT from MCS: ref #630042
2018-11-26 04:22:33 [DEBUG   ] summary = ERROR
2018-11-26 04:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630042  13 58448 15753365 A  ERRORERROR'
2018-11-26 04:22:33 [DEBUG   ] Got command RPT from MCS: ref #630044
2018-11-26 04:22:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630044  77 58448 15753569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:22:33 [DEBUG   ] Got command RPT from MCS: ref #630045
2018-11-26 04:22:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630045  12 58448 15753773 A  ERRORB—™š'
2018-11-26 04:22:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 04:22:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 04:23:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:23:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:23:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:23:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:23:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:23:04 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-11-26 04:23:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 04:23:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 04:23:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 04:24:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:24:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:24:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:24:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:24:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:24:04 [WARNING ] (13, 1, 'bot')
2018-11-26 04:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:24:04 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-26 04:24:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 04:24:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 04:24:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 04:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:25:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:25:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:25:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:25:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:25:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:25:05 [DEBUG   ] Finished updating board flags in 2.200 seconds
2018-11-26 04:25:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:25:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 04:25:48 [DEBUG   ] Got command RPT from MCS: ref #630054
2018-11-26 04:25:48 [DEBUG   ] summary = ERROR
2018-11-26 04:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630054  13 58448 15948597 A  ERRORERROR'
2018-11-26 04:25:48 [DEBUG   ] Got command RPT from MCS: ref #630055
2018-11-26 04:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630055  77 58448 15948598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:25:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 04:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:26:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:26:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:26:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:26:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:26:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:26:05 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-11-26 04:26:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 04:26:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 04:26:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 04:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:27:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:27:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:27:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:27:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:27:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:27:05 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-11-26 04:27:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 04:27:33 [DEBUG   ] Got command RPT from MCS: ref #630071
2018-11-26 04:27:33 [DEBUG   ] summary = ERROR
2018-11-26 04:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630071  13 58448 16053041 A  ERRORERROR'
2018-11-26 04:27:33 [DEBUG   ] Got command RPT from MCS: ref #630072
2018-11-26 04:27:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630072  77 58448 16053245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:27:33 [DEBUG   ] Got command RPT from MCS: ref #630073
2018-11-26 04:27:33 [DEBUG   ] summary = ERROR
2018-11-26 04:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630073  13 58448 16053449 A  ERRORERROR'
2018-11-26 04:27:33 [DEBUG   ] Got command RPT from MCS: ref #630074
2018-11-26 04:27:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630074  77 58448 16053641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:27:33 [DEBUG   ] Got command RPT from MCS: ref #630075
2018-11-26 04:27:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630075  12 58448 16053845 A  ERRORB–™š'
2018-11-26 04:27:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:27:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 04:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:28:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:28:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:28:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:28:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:28:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:28:05 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-11-26 04:28:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:28:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 04:28:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 04:29:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:29:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:29:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:29:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:29:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:29:05 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-26 04:29:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 04:29:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 04:29:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 04:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:30:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:30:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:30:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:30:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:30:05 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-26 04:30:18 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-26 04:30:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 04:30:48 [DEBUG   ] Got command RPT from MCS: ref #630084
2018-11-26 04:30:48 [DEBUG   ] summary = ERROR
2018-11-26 04:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630084  13 58448 16248601 A  ERRORERROR'
2018-11-26 04:30:48 [DEBUG   ] Got command RPT from MCS: ref #630085
2018-11-26 04:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630085  77 58448 16248602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:30:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 04:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:31:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:31:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:31:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:31:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:31:05 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-11-26 04:31:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:31:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 04:31:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 04:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:32:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:32:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:32:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:32:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:32:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:32:05 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-26 04:32:19 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 04:32:33 [DEBUG   ] Got command RPT from MCS: ref #630103
2018-11-26 04:32:33 [DEBUG   ] summary = ERROR
2018-11-26 04:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630103  13 58448 16353129 A  ERRORERROR'
2018-11-26 04:32:33 [DEBUG   ] Got command RPT from MCS: ref #630104
2018-11-26 04:32:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630104  77 58448 16353321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:32:33 [DEBUG   ] Got command RPT from MCS: ref #630105
2018-11-26 04:32:33 [DEBUG   ] summary = ERROR
2018-11-26 04:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630105  13 58448 16353525 A  ERRORERROR'
2018-11-26 04:32:33 [DEBUG   ] Got command RPT from MCS: ref #630107
2018-11-26 04:32:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630107  77 58448 16353729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:32:33 [DEBUG   ] Got command RPT from MCS: ref #630108
2018-11-26 04:32:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630108  12 58448 16353933 A  ERRORB˜™š'
2018-11-26 04:32:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:32:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:33:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:33:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:33:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:33:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:33:05 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-11-26 04:33:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 04:33:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 04:33:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 04:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 04:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:34:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:34:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:34:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:34:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:34:05 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-26 04:34:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:34:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:34:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:35:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:35:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:35:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:35:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:35:05 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-26 04:35:19 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-26 04:35:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 04:35:48 [DEBUG   ] Got command RPT from MCS: ref #630117
2018-11-26 04:35:48 [DEBUG   ] summary = ERROR
2018-11-26 04:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630117  13 58448 16548601 A  ERRORERROR'
2018-11-26 04:35:48 [DEBUG   ] Got command RPT from MCS: ref #630118
2018-11-26 04:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630118  77 58448 16548602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:36:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 04:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:36:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:36:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:36:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:36:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:36:05 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-26 04:36:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 04:36:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 04:37:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 04:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:37:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:37:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:37:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:37:05 [WARNING ] (13, 1, 'bot')
2018-11-26 04:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:37:05 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-11-26 04:37:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 04:37:33 [DEBUG   ] Got command RPT from MCS: ref #630138
2018-11-26 04:37:33 [DEBUG   ] summary = ERROR
2018-11-26 04:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630138  13 58448 16653201 A  ERRORERROR'
2018-11-26 04:37:33 [DEBUG   ] Got command RPT from MCS: ref #630139
2018-11-26 04:37:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630139  77 58448 16653405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:37:33 [DEBUG   ] Got command RPT from MCS: ref #630140
2018-11-26 04:37:33 [DEBUG   ] summary = ERROR
2018-11-26 04:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630140  13 58448 16653609 A  ERRORERROR'
2018-11-26 04:37:33 [DEBUG   ] Got command RPT from MCS: ref #630141
2018-11-26 04:37:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630141  77 58448 16653801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:37:34 [DEBUG   ] Got command RPT from MCS: ref #630142
2018-11-26 04:37:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630142  12 58448 16654005 A  ERRORB—™š'
2018-11-26 04:37:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:38:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:38:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:38:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:38:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:38:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:38:06 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-11-26 04:38:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:38:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 04:39:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 04:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:39:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:39:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:39:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:39:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:39:06 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-11-26 04:39:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 04:39:41 [DEBUG   ] Finished updating ant stats in 1.804 seconds
2018-11-26 04:40:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 04:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:40:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:40:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:40:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:40:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:40:06 [DEBUG   ] Finished updating board flags in 1.952 seconds
2018-11-26 04:40:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 04:40:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 04:40:48 [DEBUG   ] Got command RPT from MCS: ref #630147
2018-11-26 04:40:48 [DEBUG   ] summary = ERROR
2018-11-26 04:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630147  13 58448 16848593 A  ERRORERROR'
2018-11-26 04:40:48 [DEBUG   ] Got command RPT from MCS: ref #630148
2018-11-26 04:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630148  77 58448 16848594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:41:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-26 04:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:41:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:41:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:41:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:41:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:41:06 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-11-26 04:41:21 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 04:41:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 04:42:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 04:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:42:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:42:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:42:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:42:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:42:06 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-11-26 04:42:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 04:42:33 [DEBUG   ] Got command RPT from MCS: ref #630166
2018-11-26 04:42:33 [DEBUG   ] summary = ERROR
2018-11-26 04:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630166  13 58448 16953281 A  ERRORERROR'
2018-11-26 04:42:33 [DEBUG   ] Got command RPT from MCS: ref #630167
2018-11-26 04:42:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630167  77 58448 16953485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:42:33 [DEBUG   ] Got command RPT from MCS: ref #630168
2018-11-26 04:42:33 [DEBUG   ] summary = ERROR
2018-11-26 04:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630168  13 58448 16953677 A  ERRORERROR'
2018-11-26 04:42:33 [DEBUG   ] Got command RPT from MCS: ref #630169
2018-11-26 04:42:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630169  77 58448 16953881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:42:34 [DEBUG   ] Got command RPT from MCS: ref #630171
2018-11-26 04:42:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630171  12 58448 16954085 A  ERRORB–™š'
2018-11-26 04:42:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 04:43:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 04:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:43:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:43:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:43:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:43:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:43:06 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-26 04:43:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 04:43:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 04:44:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 04:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:44:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:44:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:44:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:44:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:44:06 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-26 04:44:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 04:44:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 04:45:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 04:45:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:45:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:45:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:45:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:45:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:45:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:45:06 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-26 04:45:21 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-26 04:45:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 04:45:48 [DEBUG   ] Got command RPT from MCS: ref #630184
2018-11-26 04:45:48 [DEBUG   ] summary = ERROR
2018-11-26 04:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630184  13 58448 17148601 A  ERRORERROR'
2018-11-26 04:45:48 [DEBUG   ] Got command RPT from MCS: ref #630185
2018-11-26 04:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630185  77 58448 17148602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:46:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:46:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:46:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:46:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:46:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:46:06 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-11-26 04:46:21 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-11-26 04:46:41 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-26 04:47:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 04:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:47:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:47:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:47:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:47:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:47:06 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-11-26 04:47:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:47:33 [DEBUG   ] Got command RPT from MCS: ref #630201
2018-11-26 04:47:33 [DEBUG   ] summary = ERROR
2018-11-26 04:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630201  13 58448 17253361 A  ERRORERROR'
2018-11-26 04:47:33 [DEBUG   ] Got command RPT from MCS: ref #630202
2018-11-26 04:47:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630202  77 58448 17253565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:47:33 [DEBUG   ] Got command RPT from MCS: ref #630203
2018-11-26 04:47:33 [DEBUG   ] summary = ERROR
2018-11-26 04:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630203  13 58448 17253757 A  ERRORERROR'
2018-11-26 04:47:33 [DEBUG   ] Got command RPT from MCS: ref #630204
2018-11-26 04:47:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630204  77 58448 17253961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:47:34 [DEBUG   ] Got command RPT from MCS: ref #630205
2018-11-26 04:47:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630205  12 58448 17254165 A  ERRORB˜™š'
2018-11-26 04:47:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 04:48:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 04:48:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:48:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:48:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:48:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:48:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:48:06 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-26 04:48:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 04:48:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 04:49:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 04:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:49:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:49:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:49:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:49:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:49:06 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-26 04:49:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 04:49:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 04:50:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 04:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:50:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:50:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:50:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:50:06 [WARNING ] (13, 1, 'bot')
2018-11-26 04:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:50:06 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-11-26 04:50:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:50:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:50:48 [DEBUG   ] Got command RPT from MCS: ref #630210
2018-11-26 04:50:48 [DEBUG   ] summary = ERROR
2018-11-26 04:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630210  13 58448 17448601 A  ERRORERROR'
2018-11-26 04:50:48 [DEBUG   ] Got command RPT from MCS: ref #630211
2018-11-26 04:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630211  77 58448 17448602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:51:02 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 04:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 04:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:51:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:51:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:51:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:51:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:51:07 [DEBUG   ] Finished updating board flags in 2.247 seconds
2018-11-26 04:51:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 04:51:42 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-26 04:52:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 04:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:52:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:52:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:52:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:52:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:52:07 [DEBUG   ] Finished updating board flags in 2.145 seconds
2018-11-26 04:52:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:52:33 [DEBUG   ] Got command RPT from MCS: ref #630233
2018-11-26 04:52:33 [DEBUG   ] summary = ERROR
2018-11-26 04:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630233  13 58448 17553437 A  ERRORERROR'
2018-11-26 04:52:33 [DEBUG   ] Got command RPT from MCS: ref #630234
2018-11-26 04:52:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630234  77 58448 17553641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:52:33 [DEBUG   ] Got command RPT from MCS: ref #630235
2018-11-26 04:52:33 [DEBUG   ] summary = ERROR
2018-11-26 04:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630235  13 58448 17553845 A  ERRORERROR'
2018-11-26 04:52:34 [DEBUG   ] Got command RPT from MCS: ref #630237
2018-11-26 04:52:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630237  77 58448 17554037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:52:34 [DEBUG   ] Got command RPT from MCS: ref #630238
2018-11-26 04:52:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630238  12 58448 17554241 A  ERRORB—™š'
2018-11-26 04:52:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:53:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:53:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 04:53:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:53:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:53:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:53:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:53:07 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-11-26 04:53:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 04:53:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 04:54:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 04:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:54:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:54:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:54:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:54:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:54:07 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-26 04:54:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 04:54:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 04:55:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 04:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:55:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:55:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:55:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:55:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:55:07 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-11-26 04:55:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 04:55:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:55:48 [DEBUG   ] Got command RPT from MCS: ref #630247
2018-11-26 04:55:48 [DEBUG   ] summary = ERROR
2018-11-26 04:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630247  13 58448 17748601 A  ERRORERROR'
2018-11-26 04:55:48 [DEBUG   ] Got command RPT from MCS: ref #630248
2018-11-26 04:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630248  77 58448 17748602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:56:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 04:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:56:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:56:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:56:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:56:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:56:07 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-26 04:56:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 04:56:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 04:57:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 04:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 04:57:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:57:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:57:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:57:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:57:07 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-11-26 04:57:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 04:57:33 [DEBUG   ] Got command RPT from MCS: ref #630264
2018-11-26 04:57:33 [DEBUG   ] summary = ERROR
2018-11-26 04:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630264  13 58448 17853525 A  ERRORERROR'
2018-11-26 04:57:33 [DEBUG   ] Got command RPT from MCS: ref #630265
2018-11-26 04:57:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630265  77 58448 17853717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:57:33 [DEBUG   ] Got command RPT from MCS: ref #630266
2018-11-26 04:57:33 [DEBUG   ] summary = ERROR
2018-11-26 04:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630266  13 58448 17853921 A  ERRORERROR'
2018-11-26 04:57:34 [DEBUG   ] Got command RPT from MCS: ref #630267
2018-11-26 04:57:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 04:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630267  77 58448 17854125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 04:57:34 [DEBUG   ] Got command RPT from MCS: ref #630268
2018-11-26 04:57:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 04:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630268  12 58448 17854317 A  ERRORB•™š'
2018-11-26 04:57:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 04:58:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 04:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:58:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:58:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:58:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:58:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:58:07 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-26 04:58:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 04:58:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 04:59:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 04:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 04:59:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:59:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:59:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:59:07 [WARNING ] (13, 1, 'bot')
2018-11-26 04:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 04:59:07 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-26 04:59:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 04:59:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 05:00:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 05:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:00:07 [WARNING ] (13, 1, 'bot')
2018-11-26 05:00:07 [WARNING ] (13, 1, 'bot')
2018-11-26 05:00:07 [WARNING ] (13, 1, 'bot')
2018-11-26 05:00:07 [WARNING ] (13, 1, 'bot')
2018-11-26 05:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:00:07 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-26 05:00:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:00:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:00:48 [DEBUG   ] Got command RPT from MCS: ref #630277
2018-11-26 05:00:48 [DEBUG   ] summary = ERROR
2018-11-26 05:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630277  13 58448 18048609 A  ERRORERROR'
2018-11-26 05:00:48 [DEBUG   ] Got command RPT from MCS: ref #630278
2018-11-26 05:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630278  77 58448 18048610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:01:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 05:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:01:07 [WARNING ] (13, 1, 'bot')
2018-11-26 05:01:07 [WARNING ] (13, 1, 'bot')
2018-11-26 05:01:07 [WARNING ] (13, 1, 'bot')
2018-11-26 05:01:07 [WARNING ] (13, 1, 'bot')
2018-11-26 05:01:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:01:07 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-11-26 05:01:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 05:01:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 05:02:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 05:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 05:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:02:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:02:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:02:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:02:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:02:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:02:08 [DEBUG   ] Finished updating board flags in 2.044 seconds
2018-11-26 05:02:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 05:02:33 [DEBUG   ] Got command RPT from MCS: ref #630296
2018-11-26 05:02:33 [DEBUG   ] summary = ERROR
2018-11-26 05:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630296  13 58448 18153601 A  ERRORERROR'
2018-11-26 05:02:33 [DEBUG   ] Got command RPT from MCS: ref #630297
2018-11-26 05:02:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630297  77 58448 18153810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:02:34 [DEBUG   ] Got command RPT from MCS: ref #630298
2018-11-26 05:02:34 [DEBUG   ] summary = ERROR
2018-11-26 05:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630298  13 58448 18154001 A  ERRORERROR'
2018-11-26 05:02:34 [DEBUG   ] Got command RPT from MCS: ref #630300
2018-11-26 05:02:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630300  77 58448 18154205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:02:34 [DEBUG   ] Got command RPT from MCS: ref #630302
2018-11-26 05:02:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630302  12 58448 18154397 A  ERRORB—™š'
2018-11-26 05:02:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 05:03:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 05:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:03:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:03:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:03:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:03:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:03:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:03:08 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-11-26 05:03:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 05:03:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 05:04:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 05:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:04:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:04:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:04:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:04:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:04:08 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-11-26 05:04:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 05:04:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 05:05:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 05:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:05:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:05:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:05:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:05:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:05:08 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-11-26 05:05:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 05:05:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:05:48 [DEBUG   ] Got command RPT from MCS: ref #630310
2018-11-26 05:05:48 [DEBUG   ] summary = ERROR
2018-11-26 05:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630310  13 58448 18348609 A  ERRORERROR'
2018-11-26 05:05:48 [DEBUG   ] Got command RPT from MCS: ref #630311
2018-11-26 05:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630311  77 58448 18348610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:06:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 05:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:06:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:06:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:06:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:06:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:06:08 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-11-26 05:06:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 05:06:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 05:07:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 05:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:07:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:07:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:07:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:07:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:07:08 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-11-26 05:07:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 05:07:33 [DEBUG   ] Got command RPT from MCS: ref #630331
2018-11-26 05:07:33 [DEBUG   ] summary = ERROR
2018-11-26 05:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630331  13 58448 18453677 A  ERRORERROR'
2018-11-26 05:07:33 [DEBUG   ] Got command RPT from MCS: ref #630332
2018-11-26 05:07:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630332  77 58448 18453881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:07:34 [DEBUG   ] Got command RPT from MCS: ref #630333
2018-11-26 05:07:34 [DEBUG   ] summary = ERROR
2018-11-26 05:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630333  13 58448 18454088 A  ERRORERROR'
2018-11-26 05:07:34 [DEBUG   ] Got command RPT from MCS: ref #630334
2018-11-26 05:07:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630334  77 58448 18454277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:07:34 [DEBUG   ] Got command RPT from MCS: ref #630335
2018-11-26 05:07:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630335  12 58448 18454481 A  ERRORB—™š'
2018-11-26 05:07:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 05:08:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 05:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:08:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:08:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:08:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:08:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:08:08 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-26 05:08:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 05:08:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 05:09:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 05:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:09:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:09:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:09:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:09:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:09:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:09:08 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-26 05:09:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 05:09:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 05:10:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:10:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:10:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:10:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:10:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:10:08 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-26 05:10:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:10:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 05:10:48 [DEBUG   ] Got command RPT from MCS: ref #630340
2018-11-26 05:10:48 [DEBUG   ] summary = ERROR
2018-11-26 05:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630340  13 58448 18648605 A  ERRORERROR'
2018-11-26 05:10:48 [DEBUG   ] Got command RPT from MCS: ref #630341
2018-11-26 05:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630341  77 58448 18648606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:11:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 05:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:11:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:11:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:11:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:11:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:11:08 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-26 05:11:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 05:11:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 05:12:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 05:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 05:12:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:12:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:12:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:12:08 [WARNING ] (13, 1, 'bot')
2018-11-26 05:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:12:08 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-11-26 05:12:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 05:12:33 [DEBUG   ] Got command RPT from MCS: ref #630359
2018-11-26 05:12:33 [DEBUG   ] summary = ERROR
2018-11-26 05:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630359  13 58448 18753753 A  ERRORERROR'
2018-11-26 05:12:33 [DEBUG   ] Got command RPT from MCS: ref #630360
2018-11-26 05:12:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630360  77 58448 18753957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:12:34 [DEBUG   ] Got command RPT from MCS: ref #630361
2018-11-26 05:12:34 [DEBUG   ] summary = ERROR
2018-11-26 05:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630361  13 58448 18754161 A  ERRORERROR'
2018-11-26 05:12:34 [DEBUG   ] Got command RPT from MCS: ref #630363
2018-11-26 05:12:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630363  77 58448 18754365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:12:34 [DEBUG   ] Got command RPT from MCS: ref #630365
2018-11-26 05:12:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630365  12 58448 18754557 A  ERRORB–™š'
2018-11-26 05:12:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 05:13:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 05:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:13:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:13:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:13:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:13:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:13:09 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-11-26 05:13:26 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 05:13:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 05:14:07 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-26 05:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:14:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 05:14:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:14:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:14:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:14:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:14:09 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-11-26 05:14:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 05:14:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 05:15:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 05:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:15:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 05:15:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:15:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:15:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:15:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:15:09 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-26 05:15:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 05:15:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 05:15:48 [DEBUG   ] Got command RPT from MCS: ref #630377
2018-11-26 05:15:48 [DEBUG   ] summary = ERROR
2018-11-26 05:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630377  13 58448 18948601 A  ERRORERROR'
2018-11-26 05:15:48 [DEBUG   ] Got command RPT from MCS: ref #630378
2018-11-26 05:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630378  77 58448 18948602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:16:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 05:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:16:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:16:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:16:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:16:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:16:09 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-11-26 05:16:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:16:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 05:17:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 05:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:17:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 05:17:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:17:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:17:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:17:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:17:09 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-11-26 05:17:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 05:17:33 [DEBUG   ] Got command RPT from MCS: ref #630394
2018-11-26 05:17:33 [DEBUG   ] summary = ERROR
2018-11-26 05:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630394  13 58448 19053845 A  ERRORERROR'
2018-11-26 05:17:34 [DEBUG   ] Got command RPT from MCS: ref #630395
2018-11-26 05:17:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630395  77 58448 19054037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:17:34 [DEBUG   ] Got command RPT from MCS: ref #630396
2018-11-26 05:17:34 [DEBUG   ] summary = ERROR
2018-11-26 05:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630396  13 58448 19054241 A  ERRORERROR'
2018-11-26 05:17:34 [DEBUG   ] Got command RPT from MCS: ref #630397
2018-11-26 05:17:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630397  77 58448 19054445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:17:34 [DEBUG   ] Got command RPT from MCS: ref #630398
2018-11-26 05:17:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630398  12 58448 19054649 A  ERRORB–™š'
2018-11-26 05:17:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 05:18:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:18:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:18:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:18:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:18:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:18:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:18:09 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-11-26 05:18:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:18:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:19:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:19:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:19:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:19:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:19:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:19:09 [DEBUG   ] Finished updating board flags in 1.655 seconds
2018-11-26 05:19:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 05:19:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 05:20:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 05:20:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:20:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:20:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:20:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:20:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:20:09 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-11-26 05:20:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 05:20:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 05:20:48 [DEBUG   ] Got command RPT from MCS: ref #630403
2018-11-26 05:20:48 [DEBUG   ] summary = ERROR
2018-11-26 05:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630403  13 58448 19248609 A  ERRORERROR'
2018-11-26 05:20:48 [DEBUG   ] Got command RPT from MCS: ref #630404
2018-11-26 05:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630404  77 58448 19248610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:21:07 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 05:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:21:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:21:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:21:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:21:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:21:09 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-11-26 05:21:28 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 05:21:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 05:22:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 05:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:22:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:22:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:22:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:22:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:22:09 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-11-26 05:22:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 05:22:33 [DEBUG   ] Got command RPT from MCS: ref #630426
2018-11-26 05:22:33 [DEBUG   ] summary = ERROR
2018-11-26 05:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630426  13 58448 19353925 A  ERRORERROR'
2018-11-26 05:22:34 [DEBUG   ] Got command RPT from MCS: ref #630427
2018-11-26 05:22:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630427  77 58448 19354117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:22:34 [DEBUG   ] Got command RPT from MCS: ref #630428
2018-11-26 05:22:34 [DEBUG   ] summary = ERROR
2018-11-26 05:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630428  13 58448 19354321 A  ERRORERROR'
2018-11-26 05:22:34 [DEBUG   ] Got command RPT from MCS: ref #630430
2018-11-26 05:22:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630430  77 58448 19354525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:22:34 [DEBUG   ] Got command RPT from MCS: ref #630432
2018-11-26 05:22:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630432  12 58448 19354729 A  ERRORB˜™š'
2018-11-26 05:22:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:23:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 05:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:23:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:23:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:23:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:23:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:23:09 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-11-26 05:23:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 05:23:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 05:24:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:24:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:24:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:24:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:24:09 [WARNING ] (13, 1, 'bot')
2018-11-26 05:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:24:09 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-11-26 05:24:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:24:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 05:25:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 05:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:25:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:25:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:25:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:25:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:25:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:25:10 [DEBUG   ] Finished updating board flags in 2.198 seconds
2018-11-26 05:25:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 05:25:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 05:25:48 [DEBUG   ] Got command RPT from MCS: ref #630440
2018-11-26 05:25:48 [DEBUG   ] summary = ERROR
2018-11-26 05:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630440  13 58448 19548605 A  ERRORERROR'
2018-11-26 05:25:48 [DEBUG   ] Got command RPT from MCS: ref #630441
2018-11-26 05:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630441  77 58448 19548606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:26:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 05:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:26:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:26:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:26:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:26:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:26:10 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-11-26 05:26:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 05:26:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 05:27:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 05:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:27:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:27:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:27:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:27:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:27:10 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-11-26 05:27:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 05:27:34 [DEBUG   ] Got command RPT from MCS: ref #630457
2018-11-26 05:27:34 [DEBUG   ] summary = ERROR
2018-11-26 05:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630457  13 58448 19654005 A  ERRORERROR'
2018-11-26 05:27:34 [DEBUG   ] Got command RPT from MCS: ref #630458
2018-11-26 05:27:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630458  77 58448 19654209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:27:34 [DEBUG   ] Got command RPT from MCS: ref #630459
2018-11-26 05:27:34 [DEBUG   ] summary = ERROR
2018-11-26 05:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630459  13 58448 19654401 A  ERRORERROR'
2018-11-26 05:27:34 [DEBUG   ] Got command RPT from MCS: ref #630460
2018-11-26 05:27:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630460  77 58448 19654605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:27:34 [DEBUG   ] Got command RPT from MCS: ref #630461
2018-11-26 05:27:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630461  12 58448 19654809 A  ERRORB—™š'
2018-11-26 05:27:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 05:28:09 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2018-11-26 05:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:28:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:28:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:28:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:28:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:28:10 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-11-26 05:28:29 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-11-26 05:28:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 05:29:09 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-11-26 05:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:29:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:29:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:29:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:29:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:29:10 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-26 05:29:29 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-11-26 05:29:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 05:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:30:09 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-11-26 05:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:30:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:30:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:30:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:30:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:30:10 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-26 05:30:29 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-11-26 05:30:48 [DEBUG   ] Got command RPT from MCS: ref #630470
2018-11-26 05:30:48 [DEBUG   ] summary = ERROR
2018-11-26 05:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630470  13 58448 19848613 A  ERRORERROR'
2018-11-26 05:30:48 [DEBUG   ] Got command RPT from MCS: ref #630471
2018-11-26 05:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630471  77 58448 19848614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:30:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 05:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:31:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 05:31:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:31:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:31:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:31:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:31:10 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-26 05:31:30 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 05:31:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 05:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:32:10 [DEBUG   ] Finished updating ant stats in 1.244 seconds
2018-11-26 05:32:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:32:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:32:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:32:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:32:10 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-11-26 05:32:30 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-11-26 05:32:34 [DEBUG   ] Got command RPT from MCS: ref #630489
2018-11-26 05:32:34 [DEBUG   ] summary = ERROR
2018-11-26 05:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630489  13 58448 19954085 A  ERRORERROR'
2018-11-26 05:32:34 [DEBUG   ] Got command RPT from MCS: ref #630490
2018-11-26 05:32:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630490  77 58448 19954277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:32:34 [DEBUG   ] Got command RPT from MCS: ref #630491
2018-11-26 05:32:34 [DEBUG   ] summary = ERROR
2018-11-26 05:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630491  13 58448 19954481 A  ERRORERROR'
2018-11-26 05:32:34 [DEBUG   ] Got command RPT from MCS: ref #630493
2018-11-26 05:32:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630493  77 58448 19954685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:32:34 [DEBUG   ] Got command RPT from MCS: ref #630494
2018-11-26 05:32:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630494  12 58448 19954889 A  ERRORB–™š'
2018-11-26 05:32:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:33:10 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-11-26 05:33:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:33:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:33:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:33:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:33:10 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-11-26 05:33:30 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-11-26 05:33:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:34:10 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-11-26 05:34:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:34:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:34:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:34:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:34:10 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-11-26 05:34:30 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-11-26 05:34:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 05:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:35:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:35:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:35:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:35:10 [WARNING ] (13, 1, 'bot')
2018-11-26 05:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:35:10 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-11-26 05:35:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 05:35:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 05:35:48 [DEBUG   ] Got command RPT from MCS: ref #630503
2018-11-26 05:35:48 [DEBUG   ] summary = ERROR
2018-11-26 05:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630503  13 58448 20148609 A  ERRORERROR'
2018-11-26 05:35:48 [DEBUG   ] Got command RPT from MCS: ref #630504
2018-11-26 05:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630504  77 58448 20148610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:35:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 05:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:36:11 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-11-26 05:36:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:36:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:36:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:36:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:36:11 [DEBUG   ] Finished updating board flags in 2.264 seconds
2018-11-26 05:36:31 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-11-26 05:36:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:37:11 [DEBUG   ] Finished updating ant stats in 0.839 seconds
2018-11-26 05:37:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:37:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:37:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:37:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:37:11 [DEBUG   ] Finished updating board flags in 2.197 seconds
2018-11-26 05:37:31 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-11-26 05:37:34 [DEBUG   ] Got command RPT from MCS: ref #630524
2018-11-26 05:37:34 [DEBUG   ] summary = ERROR
2018-11-26 05:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630524  13 58448 20254165 A  ERRORERROR'
2018-11-26 05:37:34 [DEBUG   ] Got command RPT from MCS: ref #630525
2018-11-26 05:37:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630525  77 58448 20254369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:37:34 [DEBUG   ] Got command RPT from MCS: ref #630526
2018-11-26 05:37:34 [DEBUG   ] summary = ERROR
2018-11-26 05:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630526  13 58448 20254561 A  ERRORERROR'
2018-11-26 05:37:34 [DEBUG   ] Got command RPT from MCS: ref #630527
2018-11-26 05:37:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630527  77 58448 20254765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:37:34 [DEBUG   ] Got command RPT from MCS: ref #630528
2018-11-26 05:37:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630528  12 58448 20254969 A  ERRORB•™š'
2018-11-26 05:37:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 05:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:38:11 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-11-26 05:38:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:38:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:38:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:38:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:38:11 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-26 05:38:31 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-11-26 05:38:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 05:39:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:39:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 05:39:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:39:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:39:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:39:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:39:11 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-11-26 05:39:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 05:39:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 05:39:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 05:40:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:40:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:40:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:40:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:40:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:40:11 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-11-26 05:40:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 05:40:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 05:40:48 [DEBUG   ] Got command RPT from MCS: ref #630533
2018-11-26 05:40:48 [DEBUG   ] summary = ERROR
2018-11-26 05:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630533  13 58448 20448613 A  ERRORERROR'
2018-11-26 05:40:48 [DEBUG   ] Got command RPT from MCS: ref #630534
2018-11-26 05:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630534  77 58448 20448614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:40:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 05:41:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 05:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:41:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:41:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:41:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:41:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:41:11 [DEBUG   ] Finished updating board flags in 1.851 seconds
2018-11-26 05:41:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:41:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:41:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 05:42:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 05:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:42:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:42:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:42:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:42:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:42:11 [DEBUG   ] Finished updating board flags in 1.751 seconds
2018-11-26 05:42:12 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-26 05:42:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:42:34 [DEBUG   ] Got command RPT from MCS: ref #630552
2018-11-26 05:42:34 [DEBUG   ] summary = ERROR
2018-11-26 05:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630552  13 58448 20554237 A  ERRORERROR'
2018-11-26 05:42:34 [DEBUG   ] Got command RPT from MCS: ref #630553
2018-11-26 05:42:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630553  77 58448 20554441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:42:34 [DEBUG   ] Got command RPT from MCS: ref #630554
2018-11-26 05:42:34 [DEBUG   ] summary = ERROR
2018-11-26 05:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630554  13 58448 20554645 A  ERRORERROR'
2018-11-26 05:42:34 [DEBUG   ] Got command RPT from MCS: ref #630556
2018-11-26 05:42:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630556  77 58448 20554849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:42:35 [DEBUG   ] Got command RPT from MCS: ref #630557
2018-11-26 05:42:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630557  12 58448 20555041 A  ERRORB—™š'
2018-11-26 05:42:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 05:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:43:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:43:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:43:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:43:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:43:11 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-26 05:43:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:43:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 05:43:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 05:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:44:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:44:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:44:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:44:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:44:11 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-11-26 05:44:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 05:44:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 05:44:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 05:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:45:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:45:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:45:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:45:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:45:11 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-26 05:45:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 05:45:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 05:45:48 [DEBUG   ] Got command RPT from MCS: ref #630570
2018-11-26 05:45:48 [DEBUG   ] summary = ERROR
2018-11-26 05:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630570  13 58448 20748609 A  ERRORERROR'
2018-11-26 05:45:48 [DEBUG   ] Got command RPT from MCS: ref #630571
2018-11-26 05:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630571  77 58448 20748610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:45:52 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-26 05:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:46:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:46:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:46:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:46:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:46:11 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-26 05:46:13 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-26 05:46:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 05:46:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 05:47:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:47:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:47:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:47:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:47:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:47:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:47:11 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-11-26 05:47:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 05:47:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:47:34 [DEBUG   ] Got command RPT from MCS: ref #630587
2018-11-26 05:47:34 [DEBUG   ] summary = ERROR
2018-11-26 05:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630587  13 58448 20854325 A  ERRORERROR'
2018-11-26 05:47:34 [DEBUG   ] Got command RPT from MCS: ref #630588
2018-11-26 05:47:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630588  77 58448 20854529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:47:34 [DEBUG   ] Got command RPT from MCS: ref #630589
2018-11-26 05:47:34 [DEBUG   ] summary = ERROR
2018-11-26 05:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630589  13 58448 20854721 A  ERRORERROR'
2018-11-26 05:47:34 [DEBUG   ] Got command RPT from MCS: ref #630590
2018-11-26 05:47:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630590  77 58448 20854925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:47:35 [DEBUG   ] Got command RPT from MCS: ref #630591
2018-11-26 05:47:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630591  12 58448 20855129 A  ERRORB—™š'
2018-11-26 05:47:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 05:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 05:48:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:48:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:48:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:48:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:48:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:48:11 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-26 05:48:13 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 05:48:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 05:48:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 05:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:49:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 05:49:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 05:49:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:49:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:49:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:49:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:49:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:49:11 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-26 05:49:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:49:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:49:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 05:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:50:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:50:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:50:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:50:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:50:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:50:11 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-11-26 05:50:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 05:50:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 05:50:48 [DEBUG   ] Got command RPT from MCS: ref #630596
2018-11-26 05:50:48 [DEBUG   ] summary = ERROR
2018-11-26 05:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630596  13 58448 21048609 A  ERRORERROR'
2018-11-26 05:50:48 [DEBUG   ] Got command RPT from MCS: ref #630597
2018-11-26 05:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630597  77 58448 21048610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:50:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 05:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:51:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:51:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:51:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:51:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:51:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:51:11 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-11-26 05:51:13 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-26 05:51:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 05:51:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 05:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:52:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:52:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:52:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:52:11 [WARNING ] (13, 1, 'bot')
2018-11-26 05:52:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:52:11 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-26 05:52:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 05:52:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 05:52:34 [DEBUG   ] Got command RPT from MCS: ref #630619
2018-11-26 05:52:34 [DEBUG   ] summary = ERROR
2018-11-26 05:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630619  13 58448 21154409 A  ERRORERROR'
2018-11-26 05:52:34 [DEBUG   ] Got command RPT from MCS: ref #630620
2018-11-26 05:52:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630620  77 58448 21154601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:52:34 [DEBUG   ] Got command RPT from MCS: ref #630621
2018-11-26 05:52:34 [DEBUG   ] summary = ERROR
2018-11-26 05:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630621  13 58448 21154805 A  ERRORERROR'
2018-11-26 05:52:35 [DEBUG   ] Got command RPT from MCS: ref #630623
2018-11-26 05:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630623  77 58448 21155009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:52:35 [DEBUG   ] Got command RPT from MCS: ref #630624
2018-11-26 05:52:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630624  12 58448 21155213 A  ERRORB–™š'
2018-11-26 05:52:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 05:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:53:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:53:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:53:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:53:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:53:12 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-11-26 05:53:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 05:53:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:53:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 05:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:54:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:54:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:54:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:54:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:54:12 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-11-26 05:54:14 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 05:54:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 05:54:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 05:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:55:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:55:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:55:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:55:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:55:12 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-26 05:55:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:55:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:55:48 [DEBUG   ] Got command RPT from MCS: ref #630633
2018-11-26 05:55:48 [DEBUG   ] summary = ERROR
2018-11-26 05:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630633  13 58448 21348617 A  ERRORERROR'
2018-11-26 05:55:48 [DEBUG   ] Got command RPT from MCS: ref #630634
2018-11-26 05:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630634  77 58448 21348618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:55:54 [DEBUG   ] Finished updating ant stats in 0.807 seconds
2018-11-26 05:56:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 05:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:56:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:56:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:56:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:56:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:56:12 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-11-26 05:56:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:56:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 05:56:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 05:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:57:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 05:57:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:57:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:57:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:57:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:57:12 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-11-26 05:57:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 05:57:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 05:57:34 [DEBUG   ] Got command RPT from MCS: ref #630650
2018-11-26 05:57:34 [DEBUG   ] summary = ERROR
2018-11-26 05:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630650  13 58448 21454485 A  ERRORERROR'
2018-11-26 05:57:34 [DEBUG   ] Got command RPT from MCS: ref #630651
2018-11-26 05:57:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630651  77 58448 21454689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:57:34 [DEBUG   ] Got command RPT from MCS: ref #630652
2018-11-26 05:57:34 [DEBUG   ] summary = ERROR
2018-11-26 05:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630652  13 58448 21454893 A  ERRORERROR'
2018-11-26 05:57:35 [DEBUG   ] Got command RPT from MCS: ref #630653
2018-11-26 05:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 05:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630653  77 58448 21455085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 05:57:35 [DEBUG   ] Got command RPT from MCS: ref #630654
2018-11-26 05:57:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 05:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630654  12 58448 21455289 A  ERRORB—™š'
2018-11-26 05:57:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 05:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:58:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:58:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:58:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:58:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:58:12 [DEBUG   ] Finished updating board flags in 1.929 seconds
2018-11-26 05:58:14 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 05:58:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 05:58:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 05:59:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 05:59:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:59:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:59:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:59:12 [WARNING ] (13, 1, 'bot')
2018-11-26 05:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 05:59:12 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-11-26 05:59:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 05:59:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 05:59:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:00:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:00:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:00:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:00:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:00:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:00:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:00:12 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-11-26 06:00:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:00:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 06:00:48 [DEBUG   ] Got command RPT from MCS: ref #630663
2018-11-26 06:00:48 [DEBUG   ] summary = ERROR
2018-11-26 06:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630663  13 58448 21648617 A  ERRORERROR'
2018-11-26 06:00:48 [DEBUG   ] Got command RPT from MCS: ref #630664
2018-11-26 06:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630664  77 58448 21648618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:00:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 06:01:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:01:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:01:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:01:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:01:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:01:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:01:12 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-26 06:01:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 06:01:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:01:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 06:02:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:02:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:02:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:02:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:02:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:02:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:02:12 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-11-26 06:02:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 06:02:34 [DEBUG   ] Got command RPT from MCS: ref #630682
2018-11-26 06:02:34 [DEBUG   ] summary = ERROR
2018-11-26 06:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630682  13 58448 21754570 A  ERRORERROR'
2018-11-26 06:02:34 [DEBUG   ] Got command RPT from MCS: ref #630683
2018-11-26 06:02:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630683  77 58448 21754773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:02:34 [DEBUG   ] Got command RPT from MCS: ref #630684
2018-11-26 06:02:34 [DEBUG   ] summary = ERROR
2018-11-26 06:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630684  13 58448 21754965 A  ERRORERROR'
2018-11-26 06:02:35 [DEBUG   ] Got command RPT from MCS: ref #630686
2018-11-26 06:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630686  77 58448 21755169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:02:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:02:35 [DEBUG   ] Got command RPT from MCS: ref #630687
2018-11-26 06:02:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630687  12 58448 21755373 A  ERRORB—™š'
2018-11-26 06:02:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:03:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:03:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:03:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:03:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:03:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:03:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:03:12 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-11-26 06:03:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 06:03:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 06:03:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 06:04:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:04:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:04:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:04:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:04:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:04:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:04:12 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-26 06:04:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 06:04:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 06:04:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 06:05:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:05:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:05:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:05:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:05:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:05:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:05:12 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-11-26 06:05:15 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-26 06:05:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 06:05:48 [DEBUG   ] Got command RPT from MCS: ref #630696
2018-11-26 06:05:48 [DEBUG   ] summary = ERROR
2018-11-26 06:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630696  13 58448 21948621 A  ERRORERROR'
2018-11-26 06:05:48 [DEBUG   ] Got command RPT from MCS: ref #630697
2018-11-26 06:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630697  77 58448 21948622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:05:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 06:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:06:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:06:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:06:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:06:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:06:12 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-11-26 06:06:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 06:06:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:06:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 06:07:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:07:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:07:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:07:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:07:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:07:12 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-11-26 06:07:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 06:07:34 [DEBUG   ] Got command RPT from MCS: ref #630717
2018-11-26 06:07:34 [DEBUG   ] summary = ERROR
2018-11-26 06:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630717  13 58448 22054641 A  ERRORERROR'
2018-11-26 06:07:34 [DEBUG   ] Got command RPT from MCS: ref #630718
2018-11-26 06:07:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630718  77 58448 22054845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:07:35 [DEBUG   ] Got command RPT from MCS: ref #630719
2018-11-26 06:07:35 [DEBUG   ] summary = ERROR
2018-11-26 06:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630719  13 58448 22055049 A  ERRORERROR'
2018-11-26 06:07:35 [DEBUG   ] Got command RPT from MCS: ref #630720
2018-11-26 06:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630720  77 58448 22055253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:07:35 [DEBUG   ] Got command RPT from MCS: ref #630721
2018-11-26 06:07:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630721  12 58448 22055445 A  ERRORB–™š'
2018-11-26 06:07:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 06:07:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 06:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 06:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 06:08:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:08:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:08:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:08:12 [WARNING ] (13, 1, 'bot')
2018-11-26 06:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:08:12 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-11-26 06:08:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 06:08:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 06:08:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 06:09:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:09:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:09:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:09:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:09:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:09:13 [DEBUG   ] Finished updating board flags in 2.240 seconds
2018-11-26 06:09:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 06:09:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 06:09:57 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-26 06:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:10:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:10:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:10:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:10:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:10:13 [DEBUG   ] Finished updating board flags in 2.176 seconds
2018-11-26 06:10:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 06:10:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 06:10:48 [DEBUG   ] Got command RPT from MCS: ref #630726
2018-11-26 06:10:48 [DEBUG   ] summary = ERROR
2018-11-26 06:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630726  13 58448 22248621 A  ERRORERROR'
2018-11-26 06:10:48 [DEBUG   ] Got command RPT from MCS: ref #630727
2018-11-26 06:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630727  77 58448 22248622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:10:57 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-26 06:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:11:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:11:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:11:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:11:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:11:13 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-11-26 06:11:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:11:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 06:11:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 06:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:12:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:12:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:12:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:12:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:12:13 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-26 06:12:17 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-26 06:12:34 [DEBUG   ] Got command RPT from MCS: ref #630745
2018-11-26 06:12:34 [DEBUG   ] summary = ERROR
2018-11-26 06:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630745  13 58448 22354733 A  ERRORERROR'
2018-11-26 06:12:34 [DEBUG   ] Got command RPT from MCS: ref #630746
2018-11-26 06:12:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630746  77 58448 22354925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:12:35 [DEBUG   ] Got command RPT from MCS: ref #630747
2018-11-26 06:12:35 [DEBUG   ] summary = ERROR
2018-11-26 06:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630747  13 58448 22355129 A  ERRORERROR'
2018-11-26 06:12:35 [DEBUG   ] Got command RPT from MCS: ref #630749
2018-11-26 06:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630749  77 58448 22355333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:12:35 [DEBUG   ] Got command RPT from MCS: ref #630750
2018-11-26 06:12:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630750  12 58448 22355537 A  ERRORB˜™š'
2018-11-26 06:12:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:12:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 06:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:13:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 06:13:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:13:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:13:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:13:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:13:13 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-11-26 06:13:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 06:13:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 06:13:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 06:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:14:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:14:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:14:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:14:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:14:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:14:13 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-11-26 06:14:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 06:14:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 06:14:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 06:15:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:15:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:15:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:15:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:15:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:15:13 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-26 06:15:18 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 06:15:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 06:15:48 [DEBUG   ] Got command RPT from MCS: ref #630763
2018-11-26 06:15:48 [DEBUG   ] summary = ERROR
2018-11-26 06:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630763  13 58448 22548617 A  ERRORERROR'
2018-11-26 06:15:48 [DEBUG   ] Got command RPT from MCS: ref #630764
2018-11-26 06:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630764  77 58448 22548618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:15:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 06:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:16:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:16:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:16:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:16:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:16:13 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-26 06:16:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 06:16:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 06:16:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 06:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:17:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 06:17:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:17:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:17:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:17:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:17:13 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-26 06:17:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:17:34 [DEBUG   ] Got command RPT from MCS: ref #630780
2018-11-26 06:17:34 [DEBUG   ] summary = ERROR
2018-11-26 06:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630780  13 58448 22654813 A  ERRORERROR'
2018-11-26 06:17:35 [DEBUG   ] Got command RPT from MCS: ref #630781
2018-11-26 06:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630781  77 58448 22655005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:17:35 [DEBUG   ] Got command RPT from MCS: ref #630782
2018-11-26 06:17:35 [DEBUG   ] summary = ERROR
2018-11-26 06:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630782  13 58448 22655209 A  ERRORERROR'
2018-11-26 06:17:35 [DEBUG   ] Got command RPT from MCS: ref #630783
2018-11-26 06:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630783  77 58448 22655413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:17:35 [DEBUG   ] Got command RPT from MCS: ref #630784
2018-11-26 06:17:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630784  12 58448 22655617 A  ERRORB–™š'
2018-11-26 06:17:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:17:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 06:18:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:18:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:18:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:18:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:18:13 [WARNING ] (13, 1, 'bot')
2018-11-26 06:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:18:13 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-26 06:18:18 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-26 06:18:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:18:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:19:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:19:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:19:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:19:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:19:14 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-11-26 06:19:18 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 06:19:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 06:19:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 06:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:20:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:20:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:20:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:20:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:20:14 [DEBUG   ] Finished updating board flags in 2.195 seconds
2018-11-26 06:20:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 06:20:38 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 06:20:48 [DEBUG   ] Got command RPT from MCS: ref #630789
2018-11-26 06:20:48 [DEBUG   ] summary = ERROR
2018-11-26 06:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630789  13 58448 22848625 A  ERRORERROR'
2018-11-26 06:20:48 [DEBUG   ] Got command RPT from MCS: ref #630790
2018-11-26 06:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630790  77 58448 22848626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:20:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 06:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:21:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:21:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:21:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:21:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:21:14 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-11-26 06:21:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 06:21:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 06:21:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 06:22:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:22:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:22:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:22:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:22:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:22:14 [DEBUG   ] Finished updating board flags in 1.953 seconds
2018-11-26 06:22:19 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-11-26 06:22:34 [DEBUG   ] Got command RPT from MCS: ref #630812
2018-11-26 06:22:34 [DEBUG   ] summary = ERROR
2018-11-26 06:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630812  13 58448 22954893 A  ERRORERROR'
2018-11-26 06:22:35 [DEBUG   ] Got command RPT from MCS: ref #630813
2018-11-26 06:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630813  77 58448 22955085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:22:35 [DEBUG   ] Got command RPT from MCS: ref #630814
2018-11-26 06:22:35 [DEBUG   ] summary = ERROR
2018-11-26 06:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630814  13 58448 22955289 A  ERRORERROR'
2018-11-26 06:22:35 [DEBUG   ] Got command RPT from MCS: ref #630816
2018-11-26 06:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630816  77 58448 22955493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:22:35 [DEBUG   ] Got command RPT from MCS: ref #630817
2018-11-26 06:22:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630817  12 58448 22955697 A  ERRORB•™š'
2018-11-26 06:22:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 06:22:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 06:23:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:23:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:23:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:23:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:23:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:23:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:23:14 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-26 06:23:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 06:23:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:23:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 06:24:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:24:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:24:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:24:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:24:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:24:14 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-26 06:24:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 06:24:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:24:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 06:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:25:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:25:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:25:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:25:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:25:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:25:14 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-26 06:25:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:25:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 06:25:48 [DEBUG   ] Got command RPT from MCS: ref #630826
2018-11-26 06:25:48 [DEBUG   ] summary = ERROR
2018-11-26 06:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630826  13 58448 23148621 A  ERRORERROR'
2018-11-26 06:25:48 [DEBUG   ] Got command RPT from MCS: ref #630827
2018-11-26 06:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630827  77 58448 23148622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:25:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 06:26:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:26:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:26:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:26:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:26:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:26:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:26:14 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-26 06:26:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:26:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:26:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 06:27:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:27:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:27:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:27:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:27:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:27:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:27:14 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-11-26 06:27:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 06:27:34 [DEBUG   ] Got command RPT from MCS: ref #630843
2018-11-26 06:27:34 [DEBUG   ] summary = ERROR
2018-11-26 06:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630843  13 58448 23254969 A  ERRORERROR'
2018-11-26 06:27:35 [DEBUG   ] Got command RPT from MCS: ref #630844
2018-11-26 06:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630844  77 58448 23255173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:27:35 [DEBUG   ] Got command RPT from MCS: ref #630845
2018-11-26 06:27:35 [DEBUG   ] summary = ERROR
2018-11-26 06:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630845  13 58448 23255377 A  ERRORERROR'
2018-11-26 06:27:35 [DEBUG   ] Got command RPT from MCS: ref #630846
2018-11-26 06:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630846  77 58448 23255569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:27:35 [DEBUG   ] Got command RPT from MCS: ref #630847
2018-11-26 06:27:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630847  12 58448 23255773 A  ERRORB—™š'
2018-11-26 06:27:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 06:27:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 06:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:28:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:28:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:28:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:28:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:28:14 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-26 06:28:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 06:28:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 06:28:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 06:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 06:29:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:29:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:29:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:29:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:29:14 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-26 06:29:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 06:29:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 06:30:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 06:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:30:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:30:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:30:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:30:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:30:14 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-26 06:30:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 06:30:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 06:30:48 [DEBUG   ] Got command RPT from MCS: ref #630856
2018-11-26 06:30:48 [DEBUG   ] summary = ERROR
2018-11-26 06:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630856  13 58448 23448621 A  ERRORERROR'
2018-11-26 06:30:48 [DEBUG   ] Got command RPT from MCS: ref #630857
2018-11-26 06:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630857  77 58448 23448622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:31:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 06:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:31:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:31:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:31:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:31:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:31:14 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-11-26 06:31:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 06:31:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 06:32:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 06:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:32:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 06:32:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:32:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:32:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:32:14 [WARNING ] (13, 1, 'bot')
2018-11-26 06:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:32:14 [DEBUG   ] Finished updating board flags in 1.365 seconds
2018-11-26 06:32:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 06:32:35 [DEBUG   ] Got command RPT from MCS: ref #630875
2018-11-26 06:32:35 [DEBUG   ] summary = ERROR
2018-11-26 06:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630875  13 58448 23555053 A  ERRORERROR'
2018-11-26 06:32:35 [DEBUG   ] Got command RPT from MCS: ref #630876
2018-11-26 06:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630876  77 58448 23555257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:32:35 [DEBUG   ] Got command RPT from MCS: ref #630877
2018-11-26 06:32:35 [DEBUG   ] summary = ERROR
2018-11-26 06:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630877  13 58448 23555449 A  ERRORERROR'
2018-11-26 06:32:35 [DEBUG   ] Got command RPT from MCS: ref #630879
2018-11-26 06:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630879  77 58448 23555653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:32:35 [DEBUG   ] Got command RPT from MCS: ref #630880
2018-11-26 06:32:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630880  12 58448 23555857 A  ERRORB–™š'
2018-11-26 06:32:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 06:33:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 06:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:33:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 06:33:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:33:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:33:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:33:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:33:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:33:15 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-11-26 06:33:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 06:33:41 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-26 06:34:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-11-26 06:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:34:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:34:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:34:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:34:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:34:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:34:15 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-11-26 06:34:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 06:34:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 06:35:01 [DEBUG   ] Finished updating ant stats in 0.927 seconds
2018-11-26 06:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:35:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:35:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:35:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:35:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:35:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:35:15 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-11-26 06:35:21 [DEBUG   ] Finished updating ant stats in 0.679 seconds
2018-11-26 06:35:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 06:35:48 [DEBUG   ] Got command RPT from MCS: ref #630889
2018-11-26 06:35:48 [DEBUG   ] summary = ERROR
2018-11-26 06:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630889  13 58448 23748629 A  ERRORERROR'
2018-11-26 06:35:48 [DEBUG   ] Got command RPT from MCS: ref #630890
2018-11-26 06:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630890  77 58448 23748630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:36:01 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 06:36:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:36:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 06:36:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:36:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:36:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:36:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:36:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:36:15 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-26 06:36:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 06:36:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 06:37:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 06:37:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:37:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:37:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:37:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:37:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:37:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:37:15 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-11-26 06:37:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 06:37:35 [DEBUG   ] Got command RPT from MCS: ref #630910
2018-11-26 06:37:35 [DEBUG   ] summary = ERROR
2018-11-26 06:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630910  13 58448 23855137 A  ERRORERROR'
2018-11-26 06:37:35 [DEBUG   ] Got command RPT from MCS: ref #630911
2018-11-26 06:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630911  77 58448 23855329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:37:35 [DEBUG   ] Got command RPT from MCS: ref #630912
2018-11-26 06:37:35 [DEBUG   ] summary = ERROR
2018-11-26 06:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630912  13 58448 23855533 A  ERRORERROR'
2018-11-26 06:37:35 [DEBUG   ] Got command RPT from MCS: ref #630913
2018-11-26 06:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630913  77 58448 23855737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:37:35 [DEBUG   ] Got command RPT from MCS: ref #630914
2018-11-26 06:37:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630914  12 58448 23855941 A  ERRORB•™š'
2018-11-26 06:37:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 06:38:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 06:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:38:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:38:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:38:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:38:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:38:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:38:15 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-26 06:38:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:38:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:39:02 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 06:39:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:39:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:39:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:39:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:39:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:39:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:39:15 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-26 06:39:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 06:39:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 06:40:02 [DEBUG   ] Finished updating ant stats in 0.970 seconds
2018-11-26 06:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:40:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:40:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:40:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:40:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:40:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:40:15 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-26 06:40:22 [DEBUG   ] Finished updating ant stats in 0.437 seconds
2018-11-26 06:40:43 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-26 06:40:48 [DEBUG   ] Got command RPT from MCS: ref #630919
2018-11-26 06:40:48 [DEBUG   ] summary = ERROR
2018-11-26 06:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630919  13 58448 24048621 A  ERRORERROR'
2018-11-26 06:40:48 [DEBUG   ] Got command RPT from MCS: ref #630920
2018-11-26 06:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630920  77 58448 24048622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:41:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 06:41:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 06:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:41:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 06:41:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:41:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:41:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:41:15 [WARNING ] (13, 1, 'bot')
2018-11-26 06:41:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:41:15 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-26 06:41:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 06:41:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 06:42:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:42:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:42:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:42:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:42:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:42:16 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-11-26 06:42:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:42:35 [DEBUG   ] Got command RPT from MCS: ref #630938
2018-11-26 06:42:35 [DEBUG   ] summary = ERROR
2018-11-26 06:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630938  13 58448 24155213 A  ERRORERROR'
2018-11-26 06:42:35 [DEBUG   ] Got command RPT from MCS: ref #630939
2018-11-26 06:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630939  77 58448 24155417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:42:35 [DEBUG   ] Got command RPT from MCS: ref #630940
2018-11-26 06:42:35 [DEBUG   ] summary = ERROR
2018-11-26 06:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630940  13 58448 24155609 A  ERRORERROR'
2018-11-26 06:42:35 [DEBUG   ] Got command RPT from MCS: ref #630942
2018-11-26 06:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630942  77 58448 24155813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:42:36 [DEBUG   ] Got command RPT from MCS: ref #630944
2018-11-26 06:42:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630944  12 58448 24156017 A  ERRORB—™š'
2018-11-26 06:42:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 06:43:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 06:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:43:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:43:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:43:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:43:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:43:16 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-11-26 06:43:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:43:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:44:03 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 06:44:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:44:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:44:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:44:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:44:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:44:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:44:16 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-11-26 06:44:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 06:44:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 06:45:03 [DEBUG   ] Finished updating ant stats in 0.916 seconds
2018-11-26 06:45:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:45:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:45:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:45:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:45:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:45:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:45:16 [DEBUG   ] Finished updating board flags in 2.230 seconds
2018-11-26 06:45:23 [DEBUG   ] Finished updating ant stats in 0.493 seconds
2018-11-26 06:45:44 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-26 06:45:48 [DEBUG   ] Got command RPT from MCS: ref #630956
2018-11-26 06:45:48 [DEBUG   ] summary = ERROR
2018-11-26 06:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630956  13 58448 24348625 A  ERRORERROR'
2018-11-26 06:45:48 [DEBUG   ] Got command RPT from MCS: ref #630957
2018-11-26 06:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630957  77 58448 24348626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:46:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 06:46:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:46:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:46:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:46:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:46:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:46:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:46:16 [DEBUG   ] Finished updating board flags in 2.144 seconds
2018-11-26 06:46:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 06:46:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 06:47:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:47:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:47:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:47:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:47:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:47:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:47:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:47:16 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-11-26 06:47:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:47:35 [DEBUG   ] Got command RPT from MCS: ref #630973
2018-11-26 06:47:35 [DEBUG   ] summary = ERROR
2018-11-26 06:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630973  13 58448 24455289 A  ERRORERROR'
2018-11-26 06:47:35 [DEBUG   ] Got command RPT from MCS: ref #630974
2018-11-26 06:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630974  77 58448 24455493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:47:35 [DEBUG   ] Got command RPT from MCS: ref #630975
2018-11-26 06:47:35 [DEBUG   ] summary = ERROR
2018-11-26 06:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630975  13 58448 24455697 A  ERRORERROR'
2018-11-26 06:47:35 [DEBUG   ] Got command RPT from MCS: ref #630976
2018-11-26 06:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630976  77 58448 24455901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:47:36 [DEBUG   ] Got command RPT from MCS: ref #630977
2018-11-26 06:47:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630977  12 58448 24456094 A  ERRORB–™š'
2018-11-26 06:47:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 06:48:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 06:48:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:48:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:48:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:48:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:48:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:48:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:48:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:48:16 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-11-26 06:48:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 06:48:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:49:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-26 06:49:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:49:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:49:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:49:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:49:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:49:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:49:16 [DEBUG   ] Finished updating board flags in 1.956 seconds
2018-11-26 06:49:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 06:49:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 06:50:04 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2018-11-26 06:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:50:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:50:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:50:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:50:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:50:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:50:16 [DEBUG   ] Finished updating board flags in 1.921 seconds
2018-11-26 06:50:24 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-11-26 06:50:45 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 06:50:48 [DEBUG   ] Got command RPT from MCS: ref #630982
2018-11-26 06:50:48 [DEBUG   ] summary = ERROR
2018-11-26 06:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630982  13 58448 24648633 A  ERRORERROR'
2018-11-26 06:50:48 [DEBUG   ] Got command RPT from MCS: ref #630983
2018-11-26 06:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   630983  77 58448 24648634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:51:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 06:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:51:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:51:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:51:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:51:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:51:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:51:16 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-11-26 06:51:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 06:51:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 06:52:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:52:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:52:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 06:52:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:52:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:52:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:52:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:52:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:52:16 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-26 06:52:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:52:35 [DEBUG   ] Got command RPT from MCS: ref #631005
2018-11-26 06:52:35 [DEBUG   ] summary = ERROR
2018-11-26 06:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631005  13 58448 24755373 A  ERRORERROR'
2018-11-26 06:52:35 [DEBUG   ] Got command RPT from MCS: ref #631006
2018-11-26 06:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631006  77 58448 24755577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:52:35 [DEBUG   ] Got command RPT from MCS: ref #631007
2018-11-26 06:52:35 [DEBUG   ] summary = ERROR
2018-11-26 06:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631007  13 58448 24755773 A  ERRORERROR'
2018-11-26 06:52:35 [DEBUG   ] Got command RPT from MCS: ref #631009
2018-11-26 06:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631009  77 58448 24755977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:52:36 [DEBUG   ] Got command RPT from MCS: ref #631011
2018-11-26 06:52:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631011  12 58448 24756181 A  ERRORB–™š'
2018-11-26 06:52:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 06:53:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 06:53:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:53:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:53:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:53:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:53:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:53:16 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-26 06:53:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 06:53:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 06:54:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 06:54:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:54:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:54:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:54:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:54:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:54:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:54:16 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-11-26 06:54:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 06:54:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 06:55:05 [DEBUG   ] Finished updating ant stats in 0.732 seconds
2018-11-26 06:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:55:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:55:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:55:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:55:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:55:16 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-26 06:55:25 [DEBUG   ] Finished updating ant stats in 0.472 seconds
2018-11-26 06:55:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 06:55:48 [DEBUG   ] Got command RPT from MCS: ref #631019
2018-11-26 06:55:48 [DEBUG   ] summary = ERROR
2018-11-26 06:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631019  13 58448 24948625 A  ERRORERROR'
2018-11-26 06:55:48 [DEBUG   ] Got command RPT from MCS: ref #631020
2018-11-26 06:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631020  77 58448 24948626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:56:06 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-11-26 06:56:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 06:56:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:56:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:56:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:56:16 [WARNING ] (13, 1, 'bot')
2018-11-26 06:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:56:16 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-26 06:56:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 06:56:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 06:57:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 06:57:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:57:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:57:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:57:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:57:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:57:17 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-11-26 06:57:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 06:57:35 [DEBUG   ] Got command RPT from MCS: ref #631036
2018-11-26 06:57:35 [DEBUG   ] summary = ERROR
2018-11-26 06:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631036  13 58448 25055457 A  ERRORERROR'
2018-11-26 06:57:35 [DEBUG   ] Got command RPT from MCS: ref #631037
2018-11-26 06:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631037  77 58448 25055649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:57:35 [DEBUG   ] Got command RPT from MCS: ref #631038
2018-11-26 06:57:35 [DEBUG   ] summary = ERROR
2018-11-26 06:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631038  13 58448 25055853 A  ERRORERROR'
2018-11-26 06:57:36 [DEBUG   ] Got command RPT from MCS: ref #631039
2018-11-26 06:57:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 06:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631039  77 58448 25056057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 06:57:36 [DEBUG   ] Got command RPT from MCS: ref #631040
2018-11-26 06:57:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 06:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631040  12 58448 25056261 A  ERRORB˜™š'
2018-11-26 06:57:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 06:58:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 06:58:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:58:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:58:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:58:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:58:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:58:17 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-11-26 06:58:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 06:58:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 06:59:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 06:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 06:59:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 06:59:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:59:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:59:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:59:17 [WARNING ] (13, 1, 'bot')
2018-11-26 06:59:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 06:59:17 [DEBUG   ] Finished updating board flags in 1.860 seconds
2018-11-26 06:59:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 06:59:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 07:00:07 [DEBUG   ] Finished updating ant stats in 1.419 seconds
2018-11-26 07:00:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:00:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:00:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:00:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:00:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:00:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:00:17 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-11-26 07:00:27 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2018-11-26 07:00:47 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 07:00:48 [DEBUG   ] Got command RPT from MCS: ref #631049
2018-11-26 07:00:48 [DEBUG   ] summary = ERROR
2018-11-26 07:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631049  13 58448 25248629 A  ERRORERROR'
2018-11-26 07:00:48 [DEBUG   ] Got command RPT from MCS: ref #631050
2018-11-26 07:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631050  77 58448 25248630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:01:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 07:01:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:01:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:01:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:01:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:01:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:01:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:01:17 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-11-26 07:01:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 07:01:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:02:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:02:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:02:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:02:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:02:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:02:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:02:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:02:17 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-11-26 07:02:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 07:02:35 [DEBUG   ] Got command RPT from MCS: ref #631068
2018-11-26 07:02:35 [DEBUG   ] summary = ERROR
2018-11-26 07:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631068  13 58448 25355529 A  ERRORERROR'
2018-11-26 07:02:35 [DEBUG   ] Got command RPT from MCS: ref #631069
2018-11-26 07:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631069  77 58448 25355733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:02:35 [DEBUG   ] Got command RPT from MCS: ref #631070
2018-11-26 07:02:35 [DEBUG   ] summary = ERROR
2018-11-26 07:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631070  13 58448 25355937 A  ERRORERROR'
2018-11-26 07:02:36 [DEBUG   ] Got command RPT from MCS: ref #631072
2018-11-26 07:02:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631072  77 58448 25356141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:02:36 [DEBUG   ] Got command RPT from MCS: ref #631074
2018-11-26 07:02:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631074  12 58448 25356333 A  ERRORB–™š'
2018-11-26 07:02:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 07:03:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 07:03:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:03:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:03:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:03:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:03:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:03:18 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-11-26 07:03:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:03:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:04:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:04:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 07:04:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:04:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:04:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:04:17 [WARNING ] (13, 1, 'bot')
2018-11-26 07:04:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:04:17 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-26 07:04:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:04:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 07:05:07 [DEBUG   ] Finished updating ant stats in 0.817 seconds
2018-11-26 07:05:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:05:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:05:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:05:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:05:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:05:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:05:18 [DEBUG   ] Finished updating board flags in 2.262 seconds
2018-11-26 07:05:27 [DEBUG   ] Finished updating ant stats in 0.787 seconds
2018-11-26 07:05:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 07:05:48 [DEBUG   ] Got command RPT from MCS: ref #631082
2018-11-26 07:05:48 [DEBUG   ] summary = ERROR
2018-11-26 07:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631082  13 58448 25548633 A  ERRORERROR'
2018-11-26 07:05:48 [DEBUG   ] Got command RPT from MCS: ref #631083
2018-11-26 07:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631083  77 58448 25548634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:06:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:06:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:06:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:06:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:06:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:06:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:06:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:06:18 [DEBUG   ] Finished updating board flags in 2.122 seconds
2018-11-26 07:06:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:06:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 07:07:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 07:07:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:07:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:07:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:07:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:07:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:07:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:07:18 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-26 07:07:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 07:07:35 [DEBUG   ] Got command RPT from MCS: ref #631103
2018-11-26 07:07:35 [DEBUG   ] summary = ERROR
2018-11-26 07:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631103  13 58448 25655617 A  ERRORERROR'
2018-11-26 07:07:35 [DEBUG   ] Got command RPT from MCS: ref #631104
2018-11-26 07:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631104  77 58448 25655821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:07:36 [DEBUG   ] Got command RPT from MCS: ref #631105
2018-11-26 07:07:36 [DEBUG   ] summary = ERROR
2018-11-26 07:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631105  13 58448 25656013 A  ERRORERROR'
2018-11-26 07:07:36 [DEBUG   ] Got command RPT from MCS: ref #631106
2018-11-26 07:07:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631106  77 58448 25656217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:07:36 [DEBUG   ] Got command RPT from MCS: ref #631107
2018-11-26 07:07:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631107  12 58448 25656421 A  ERRORB–™š'
2018-11-26 07:07:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 07:08:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 07:08:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 07:08:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:08:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:08:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:08:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:08:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:08:18 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-26 07:08:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 07:08:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 07:09:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 07:09:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:09:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:09:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 07:09:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:09:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:09:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:09:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:09:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:09:18 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-11-26 07:09:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:09:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:10:08 [DEBUG   ] Finished updating ant stats in 1.018 seconds
2018-11-26 07:10:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:10:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:10:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:10:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:10:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:10:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:10:18 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-26 07:10:28 [DEBUG   ] Finished updating ant stats in 0.988 seconds
2018-11-26 07:10:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 07:10:48 [DEBUG   ] Got command RPT from MCS: ref #631112
2018-11-26 07:10:48 [DEBUG   ] summary = ERROR
2018-11-26 07:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631112  13 58448 25848633 A  ERRORERROR'
2018-11-26 07:10:48 [DEBUG   ] Got command RPT from MCS: ref #631113
2018-11-26 07:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631113  77 58448 25848634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:11:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:11:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:11:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:11:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:11:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:11:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:11:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:11:18 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-11-26 07:11:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:11:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 07:12:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:12:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:12:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:12:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:12:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:12:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:12:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:12:18 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-26 07:12:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:12:35 [DEBUG   ] Got command RPT from MCS: ref #631131
2018-11-26 07:12:35 [DEBUG   ] summary = ERROR
2018-11-26 07:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631131  13 58448 25955701 A  ERRORERROR'
2018-11-26 07:12:35 [DEBUG   ] Got command RPT from MCS: ref #631132
2018-11-26 07:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631132  77 58448 25955893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:12:36 [DEBUG   ] Got command RPT from MCS: ref #631133
2018-11-26 07:12:36 [DEBUG   ] summary = ERROR
2018-11-26 07:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631133  13 58448 25956097 A  ERRORERROR'
2018-11-26 07:12:36 [DEBUG   ] Got command RPT from MCS: ref #631135
2018-11-26 07:12:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631135  77 58448 25956301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:12:36 [DEBUG   ] Got command RPT from MCS: ref #631137
2018-11-26 07:12:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631137  12 58448 25956505 A  ERRORB—™š'
2018-11-26 07:12:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:13:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 07:13:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 07:13:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:13:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 07:13:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:13:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:13:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:13:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:13:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:13:18 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-11-26 07:13:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 07:13:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 07:14:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 07:14:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:14:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:14:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:14:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:14:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:14:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:14:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:14:18 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-11-26 07:14:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 07:14:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 07:15:09 [DEBUG   ] Finished updating ant stats in 1.009 seconds
2018-11-26 07:15:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:15:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:15:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:15:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:15:18 [WARNING ] (13, 1, 'bot')
2018-11-26 07:15:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:15:18 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-26 07:15:29 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2018-11-26 07:15:48 [DEBUG   ] Got command RPT from MCS: ref #631149
2018-11-26 07:15:48 [DEBUG   ] summary = ERROR
2018-11-26 07:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631149  13 58448 26148630 A  ERRORERROR'
2018-11-26 07:15:48 [DEBUG   ] Got command RPT from MCS: ref #631150
2018-11-26 07:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631150  77 58448 26148630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:15:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 07:16:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:16:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:16:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:16:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:16:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:16:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:16:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:16:19 [DEBUG   ] Finished updating board flags in 2.197 seconds
2018-11-26 07:16:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 07:16:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 07:17:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:17:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:17:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:17:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:17:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:17:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:17:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:17:19 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-11-26 07:17:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:17:35 [DEBUG   ] Got command RPT from MCS: ref #631166
2018-11-26 07:17:35 [DEBUG   ] summary = ERROR
2018-11-26 07:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631166  13 58448 26255781 A  ERRORERROR'
2018-11-26 07:17:35 [DEBUG   ] Got command RPT from MCS: ref #631167
2018-11-26 07:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631167  77 58448 26255973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:17:36 [DEBUG   ] Got command RPT from MCS: ref #631168
2018-11-26 07:17:36 [DEBUG   ] summary = ERROR
2018-11-26 07:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631168  13 58448 26256181 A  ERRORERROR'
2018-11-26 07:17:36 [DEBUG   ] Got command RPT from MCS: ref #631169
2018-11-26 07:17:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631169  77 58448 26256381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:17:36 [DEBUG   ] Got command RPT from MCS: ref #631170
2018-11-26 07:17:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631170  12 58448 26256585 A  ERRORB—™š'
2018-11-26 07:17:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:18:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 07:18:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 07:18:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:18:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:18:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:18:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:18:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:18:19 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-26 07:18:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 07:18:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 07:19:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 07:19:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:19:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:19:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:19:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:19:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:19:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:19:19 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-26 07:19:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 07:19:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 07:20:10 [DEBUG   ] Finished updating ant stats in 1.213 seconds
2018-11-26 07:20:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:20:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:20:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:20:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:20:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:20:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:20:19 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-11-26 07:20:30 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2018-11-26 07:20:48 [DEBUG   ] Got command RPT from MCS: ref #631175
2018-11-26 07:20:48 [DEBUG   ] summary = ERROR
2018-11-26 07:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631175  13 58448 26448629 A  ERRORERROR'
2018-11-26 07:20:48 [DEBUG   ] Got command RPT from MCS: ref #631176
2018-11-26 07:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631176  77 58448 26448630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:20:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:21:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 07:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:21:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:21:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:21:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:21:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:21:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:21:19 [DEBUG   ] Finished updating board flags in 1.653 seconds
2018-11-26 07:21:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 07:21:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:22:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:22:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:22:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:22:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:22:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:22:19 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-11-26 07:22:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:22:35 [DEBUG   ] Got command RPT from MCS: ref #631198
2018-11-26 07:22:35 [DEBUG   ] summary = ERROR
2018-11-26 07:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631198  13 58448 26555853 A  ERRORERROR'
2018-11-26 07:22:36 [DEBUG   ] Got command RPT from MCS: ref #631199
2018-11-26 07:22:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631199  77 58448 26556057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:22:36 [DEBUG   ] Got command RPT from MCS: ref #631200
2018-11-26 07:22:36 [DEBUG   ] summary = ERROR
2018-11-26 07:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631200  13 58448 26556261 A  ERRORERROR'
2018-11-26 07:22:36 [DEBUG   ] Got command RPT from MCS: ref #631202
2018-11-26 07:22:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631202  77 58448 26556465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:22:36 [DEBUG   ] Got command RPT from MCS: ref #631203
2018-11-26 07:22:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631203  12 58448 26556657 A  ERRORB–™š'
2018-11-26 07:22:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 07:23:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:23:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:23:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:23:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:23:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:23:19 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-26 07:23:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:23:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:24:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 07:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:24:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:24:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:24:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:24:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:24:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:24:19 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-26 07:24:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 07:24:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 07:25:11 [DEBUG   ] Finished updating ant stats in 1.212 seconds
2018-11-26 07:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 07:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 07:25:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:25:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:25:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:25:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:25:19 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-11-26 07:25:31 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2018-11-26 07:25:48 [DEBUG   ] Got command RPT from MCS: ref #631212
2018-11-26 07:25:48 [DEBUG   ] summary = ERROR
2018-11-26 07:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631212  13 58448 26748633 A  ERRORERROR'
2018-11-26 07:25:48 [DEBUG   ] Got command RPT from MCS: ref #631213
2018-11-26 07:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631213  77 58448 26748634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:25:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 07:26:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 07:26:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:26:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 07:26:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:26:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:26:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:26:19 [WARNING ] (13, 1, 'bot')
2018-11-26 07:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:26:19 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-26 07:26:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 07:26:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:27:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:27:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:27:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:27:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:27:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:27:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:27:20 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-11-26 07:27:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:27:35 [DEBUG   ] Got command RPT from MCS: ref #631229
2018-11-26 07:27:35 [DEBUG   ] summary = ERROR
2018-11-26 07:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631229  13 58448 26855937 A  ERRORERROR'
2018-11-26 07:27:36 [DEBUG   ] Got command RPT from MCS: ref #631230
2018-11-26 07:27:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631230  77 58448 26856141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:27:36 [DEBUG   ] Got command RPT from MCS: ref #631231
2018-11-26 07:27:36 [DEBUG   ] summary = ERROR
2018-11-26 07:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631231  13 58448 26856345 A  ERRORERROR'
2018-11-26 07:27:36 [DEBUG   ] Got command RPT from MCS: ref #631232
2018-11-26 07:27:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631232  77 58448 26856549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:27:36 [DEBUG   ] Got command RPT from MCS: ref #631233
2018-11-26 07:27:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631233  12 58448 26856741 A  ERRORB—™š'
2018-11-26 07:27:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 07:28:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:28:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:28:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:28:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:28:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:28:20 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-11-26 07:28:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 07:28:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 07:29:12 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-11-26 07:29:19 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:29:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:29:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:29:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:29:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:29:20 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-11-26 07:29:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 07:29:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 07:30:12 [DEBUG   ] Finished updating ant stats in 1.012 seconds
2018-11-26 07:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:30:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:30:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:30:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:30:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:30:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:30:20 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-26 07:30:32 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2018-11-26 07:30:48 [DEBUG   ] Got command RPT from MCS: ref #631242
2018-11-26 07:30:48 [DEBUG   ] summary = ERROR
2018-11-26 07:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631242  13 58448 27048633 A  ERRORERROR'
2018-11-26 07:30:48 [DEBUG   ] Got command RPT from MCS: ref #631243
2018-11-26 07:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631243  77 58448 27048634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:30:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:31:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:31:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:31:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:31:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:31:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:31:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:31:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:31:20 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-26 07:31:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 07:31:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:32:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:32:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:32:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:32:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:32:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:32:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:32:20 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-11-26 07:32:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:32:36 [DEBUG   ] Got command RPT from MCS: ref #631261
2018-11-26 07:32:36 [DEBUG   ] summary = ERROR
2018-11-26 07:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631261  13 58448 27156017 A  ERRORERROR'
2018-11-26 07:32:36 [DEBUG   ] Got command RPT from MCS: ref #631262
2018-11-26 07:32:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631262  77 58448 27156221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:32:36 [DEBUG   ] Got command RPT from MCS: ref #631263
2018-11-26 07:32:36 [DEBUG   ] summary = ERROR
2018-11-26 07:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631263  13 58448 27156425 A  ERRORERROR'
2018-11-26 07:32:36 [DEBUG   ] Got command RPT from MCS: ref #631265
2018-11-26 07:32:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631265  77 58448 27156629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:32:36 [DEBUG   ] Got command RPT from MCS: ref #631266
2018-11-26 07:32:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631266  12 58448 27156821 A  ERRORB—™š'
2018-11-26 07:32:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 07:33:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 07:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 07:33:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:33:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:33:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:33:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:33:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:33:20 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-26 07:33:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 07:33:53 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2018-11-26 07:34:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:34:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:34:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:34:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:34:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:34:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:34:20 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-11-26 07:34:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 07:34:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 07:35:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 07:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:35:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:35:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:35:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:35:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:35:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:35:21 [DEBUG   ] Finished updating board flags in 2.204 seconds
2018-11-26 07:35:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 07:35:48 [DEBUG   ] Got command RPT from MCS: ref #631275
2018-11-26 07:35:48 [DEBUG   ] summary = ERROR
2018-11-26 07:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631275  13 58448 27348637 A  ERRORERROR'
2018-11-26 07:35:48 [DEBUG   ] Got command RPT from MCS: ref #631276
2018-11-26 07:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631276  77 58448 27348638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:35:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 07:36:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:36:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 07:36:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:36:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:36:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:36:20 [WARNING ] (13, 1, 'bot')
2018-11-26 07:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:36:20 [DEBUG   ] Finished updating board flags in 1.322 seconds
2018-11-26 07:36:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 07:36:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 07:37:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 07:37:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:37:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 07:37:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:37:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:37:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:37:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:37:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:37:21 [DEBUG   ] Finished updating board flags in 2.082 seconds
2018-11-26 07:37:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 07:37:36 [DEBUG   ] Got command RPT from MCS: ref #631296
2018-11-26 07:37:36 [DEBUG   ] summary = ERROR
2018-11-26 07:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631296  13 58448 27456105 A  ERRORERROR'
2018-11-26 07:37:36 [DEBUG   ] Got command RPT from MCS: ref #631297
2018-11-26 07:37:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631297  77 58448 27456297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:37:36 [DEBUG   ] Got command RPT from MCS: ref #631298
2018-11-26 07:37:36 [DEBUG   ] summary = ERROR
2018-11-26 07:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631298  13 58448 27456501 A  ERRORERROR'
2018-11-26 07:37:36 [DEBUG   ] Got command RPT from MCS: ref #631299
2018-11-26 07:37:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631299  77 58448 27456705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:37:36 [DEBUG   ] Got command RPT from MCS: ref #631300
2018-11-26 07:37:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631300  12 58448 27456909 A  ERRORB–™š'
2018-11-26 07:37:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 07:38:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 07:38:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:38:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 07:38:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:38:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:38:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:38:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:38:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:38:21 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-26 07:38:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 07:38:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:39:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:39:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:39:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:39:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:39:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:39:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:39:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:39:21 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-11-26 07:39:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 07:39:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 07:40:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 07:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:40:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:40:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:40:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:40:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:40:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:40:21 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-26 07:40:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 07:40:48 [DEBUG   ] Got command RPT from MCS: ref #631305
2018-11-26 07:40:48 [DEBUG   ] summary = ERROR
2018-11-26 07:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631305  13 58448 27648633 A  ERRORERROR'
2018-11-26 07:40:48 [DEBUG   ] Got command RPT from MCS: ref #631306
2018-11-26 07:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631306  77 58448 27648634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:40:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 07:41:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 07:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:41:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:41:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:41:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:41:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:41:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:41:21 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-26 07:41:35 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-26 07:41:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 07:42:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 07:42:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:42:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:42:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:42:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:42:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:42:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:42:21 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-11-26 07:42:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 07:42:36 [DEBUG   ] Got command RPT from MCS: ref #631324
2018-11-26 07:42:36 [DEBUG   ] summary = ERROR
2018-11-26 07:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631324  13 58448 27756177 A  ERRORERROR'
2018-11-26 07:42:36 [DEBUG   ] Got command RPT from MCS: ref #631325
2018-11-26 07:42:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631325  77 58448 27756381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:42:36 [DEBUG   ] Got command RPT from MCS: ref #631326
2018-11-26 07:42:36 [DEBUG   ] summary = ERROR
2018-11-26 07:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631326  13 58448 27756585 A  ERRORERROR'
2018-11-26 07:42:36 [DEBUG   ] Got command RPT from MCS: ref #631328
2018-11-26 07:42:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631328  77 58448 27756789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:42:36 [DEBUG   ] Got command RPT from MCS: ref #631330
2018-11-26 07:42:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631330  12 58448 27756981 A  ERRORB–™š'
2018-11-26 07:42:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 07:43:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 07:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:43:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 07:43:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:43:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:43:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:43:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:43:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:43:21 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-26 07:43:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 07:43:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 07:44:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 07:44:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:44:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 07:44:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:44:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:44:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:44:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:44:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:44:21 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-26 07:44:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 07:44:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:45:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:45:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:45:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:45:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:45:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:45:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:45:21 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-11-26 07:45:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 07:45:48 [DEBUG   ] Got command RPT from MCS: ref #631342
2018-11-26 07:45:48 [DEBUG   ] summary = ERROR
2018-11-26 07:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631342  13 58448 27948633 A  ERRORERROR'
2018-11-26 07:45:48 [DEBUG   ] Got command RPT from MCS: ref #631343
2018-11-26 07:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631343  77 58448 27948634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:45:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 07:46:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:46:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:46:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:46:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:46:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:46:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:46:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:46:21 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-11-26 07:46:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:46:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 07:47:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 07:47:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:47:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:47:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:47:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:47:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:47:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:47:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:47:21 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-26 07:47:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:47:36 [DEBUG   ] Got command RPT from MCS: ref #631359
2018-11-26 07:47:36 [DEBUG   ] summary = ERROR
2018-11-26 07:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631359  13 58448 28056261 A  ERRORERROR'
2018-11-26 07:47:36 [DEBUG   ] Got command RPT from MCS: ref #631360
2018-11-26 07:47:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631360  77 58448 28056465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:47:36 [DEBUG   ] Got command RPT from MCS: ref #631361
2018-11-26 07:47:36 [DEBUG   ] summary = ERROR
2018-11-26 07:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631361  13 58448 28056669 A  ERRORERROR'
2018-11-26 07:47:36 [DEBUG   ] Got command RPT from MCS: ref #631362
2018-11-26 07:47:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631362  77 58448 28056861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:47:37 [DEBUG   ] Got command RPT from MCS: ref #631363
2018-11-26 07:47:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631363  12 58448 28057065 A  ERRORB—™š'
2018-11-26 07:47:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:48:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 07:48:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:48:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:48:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:48:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:48:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:48:21 [WARNING ] (13, 1, 'bot')
2018-11-26 07:48:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:48:21 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-11-26 07:48:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:48:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 07:49:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:49:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:49:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:49:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:49:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:49:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:49:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:49:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:49:22 [DEBUG   ] Finished updating board flags in 2.171 seconds
2018-11-26 07:49:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 07:49:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 07:50:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 07:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:50:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:50:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:50:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:50:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:50:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:50:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:50:22 [DEBUG   ] Finished updating board flags in 1.944 seconds
2018-11-26 07:50:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 07:50:48 [DEBUG   ] Got command RPT from MCS: ref #631368
2018-11-26 07:50:48 [DEBUG   ] summary = ERROR
2018-11-26 07:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631368  13 58448 28248641 A  ERRORERROR'
2018-11-26 07:50:48 [DEBUG   ] Got command RPT from MCS: ref #631369
2018-11-26 07:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631369  77 58448 28248642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:50:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 07:51:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 07:51:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:51:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:51:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:51:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:51:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:51:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:51:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:51:22 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-11-26 07:51:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:51:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 07:52:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 07:52:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:52:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:52:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:52:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:52:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:52:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:52:22 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-26 07:52:36 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 07:52:36 [DEBUG   ] Got command RPT from MCS: ref #631391
2018-11-26 07:52:36 [DEBUG   ] summary = ERROR
2018-11-26 07:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631391  13 58448 28356345 A  ERRORERROR'
2018-11-26 07:52:36 [DEBUG   ] Got command RPT from MCS: ref #631392
2018-11-26 07:52:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631392  77 58448 28356549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:52:36 [DEBUG   ] Got command RPT from MCS: ref #631393
2018-11-26 07:52:36 [DEBUG   ] summary = ERROR
2018-11-26 07:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631393  13 58448 28356741 A  ERRORERROR'
2018-11-26 07:52:36 [DEBUG   ] Got command RPT from MCS: ref #631395
2018-11-26 07:52:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631395  77 58448 28356945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:52:37 [DEBUG   ] Got command RPT from MCS: ref #631397
2018-11-26 07:52:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631397  12 58448 28357149 A  ERRORB–™š'
2018-11-26 07:52:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:53:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:53:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:53:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:53:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:53:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:53:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:53:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:53:22 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-26 07:53:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 07:53:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 07:54:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 07:54:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:54:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:54:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:54:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:54:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:54:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:54:22 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-11-26 07:54:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 07:54:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 07:55:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 07:55:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 07:55:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:55:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 07:55:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:55:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:55:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:55:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:55:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:55:22 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-26 07:55:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 07:55:48 [DEBUG   ] Got command RPT from MCS: ref #631405
2018-11-26 07:55:48 [DEBUG   ] summary = ERROR
2018-11-26 07:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631405  13 58448 28548645 A  ERRORERROR'
2018-11-26 07:55:48 [DEBUG   ] Got command RPT from MCS: ref #631406
2018-11-26 07:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631406  77 58448 28548646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:55:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 07:56:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 07:56:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:56:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:56:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:56:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:56:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:56:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:56:22 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-26 07:56:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 07:56:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 07:57:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 07:57:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:57:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:57:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:57:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:57:22 [WARNING ] (13, 1, 'bot')
2018-11-26 07:57:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:57:22 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-11-26 07:57:36 [DEBUG   ] Got command RPT from MCS: ref #631422
2018-11-26 07:57:36 [DEBUG   ] summary = ERROR
2018-11-26 07:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631422  13 58448 28656421 A  ERRORERROR'
2018-11-26 07:57:36 [DEBUG   ] Got command RPT from MCS: ref #631423
2018-11-26 07:57:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631423  77 58448 28656625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:57:36 [DEBUG   ] Got command RPT from MCS: ref #631424
2018-11-26 07:57:36 [DEBUG   ] summary = ERROR
2018-11-26 07:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631424  13 58448 28656829 A  ERRORERROR'
2018-11-26 07:57:37 [DEBUG   ] Got command RPT from MCS: ref #631425
2018-11-26 07:57:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 07:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631425  77 58448 28657021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 07:57:37 [DEBUG   ] Got command RPT from MCS: ref #631426
2018-11-26 07:57:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 07:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631426  12 58448 28657225 A  ERRORB–™š'
2018-11-26 07:57:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-26 07:57:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 07:58:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 07:58:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:58:23 [WARNING ] (13, 1, 'bot')
2018-11-26 07:58:23 [WARNING ] (13, 1, 'bot')
2018-11-26 07:58:23 [WARNING ] (13, 1, 'bot')
2018-11-26 07:58:23 [WARNING ] (13, 1, 'bot')
2018-11-26 07:58:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:58:23 [DEBUG   ] Finished updating board flags in 2.243 seconds
2018-11-26 07:58:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 07:58:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 07:59:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 07:59:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 07:59:23 [WARNING ] (13, 1, 'bot')
2018-11-26 07:59:23 [WARNING ] (13, 1, 'bot')
2018-11-26 07:59:23 [WARNING ] (13, 1, 'bot')
2018-11-26 07:59:23 [WARNING ] (13, 1, 'bot')
2018-11-26 07:59:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 07:59:23 [DEBUG   ] Finished updating board flags in 2.143 seconds
2018-11-26 07:59:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 07:59:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:00:17 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-26 08:00:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:00:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:00:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:00:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:00:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:00:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:00:23 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-11-26 08:00:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:00:48 [DEBUG   ] Got command RPT from MCS: ref #631435
2018-11-26 08:00:48 [DEBUG   ] summary = ERROR
2018-11-26 08:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631435  13 58448 28848637 A  ERRORERROR'
2018-11-26 08:00:48 [DEBUG   ] Got command RPT from MCS: ref #631436
2018-11-26 08:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631436  77 58448 28848638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:00:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 08:01:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 08:01:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:01:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:01:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:01:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:01:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:01:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:01:23 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-11-26 08:01:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 08:01:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 08:02:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:02:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:02:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:02:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:02:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:02:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:02:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:02:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:02:23 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-26 08:02:36 [DEBUG   ] Got command RPT from MCS: ref #631454
2018-11-26 08:02:36 [DEBUG   ] summary = ERROR
2018-11-26 08:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631454  13 58448 28956501 A  ERRORERROR'
2018-11-26 08:02:36 [DEBUG   ] Got command RPT from MCS: ref #631455
2018-11-26 08:02:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631455  77 58448 28956705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:02:36 [DEBUG   ] Got command RPT from MCS: ref #631456
2018-11-26 08:02:36 [DEBUG   ] summary = ERROR
2018-11-26 08:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631456  13 58448 28956909 A  ERRORERROR'
2018-11-26 08:02:37 [DEBUG   ] Got command RPT from MCS: ref #631458
2018-11-26 08:02:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631458  77 58448 28957113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:02:37 [DEBUG   ] Got command RPT from MCS: ref #631459
2018-11-26 08:02:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631459  12 58448 28957305 A  ERRORB•™š'
2018-11-26 08:02:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:02:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:03:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:03:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:03:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:03:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:03:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:03:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:03:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:03:23 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-11-26 08:03:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 08:03:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 08:04:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 08:04:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:04:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:04:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:04:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:04:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:04:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:04:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:04:23 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-11-26 08:04:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 08:04:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 08:05:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 08:05:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:05:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:05:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:05:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:05:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:05:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:05:23 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-26 08:05:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:05:48 [DEBUG   ] Got command RPT from MCS: ref #631468
2018-11-26 08:05:48 [DEBUG   ] summary = ERROR
2018-11-26 08:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631468  13 58448 29148645 A  ERRORERROR'
2018-11-26 08:05:48 [DEBUG   ] Got command RPT from MCS: ref #631469
2018-11-26 08:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631469  77 58448 29148646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:05:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:06:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 08:06:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:06:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:06:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:06:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:06:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:06:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:06:23 [DEBUG   ] Finished updating board flags in 1.673 seconds
2018-11-26 08:06:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 08:06:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-26 08:07:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 08:07:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:07:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:07:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:07:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:07:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:07:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:07:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:07:23 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-11-26 08:07:36 [DEBUG   ] Got command RPT from MCS: ref #631489
2018-11-26 08:07:36 [DEBUG   ] summary = ERROR
2018-11-26 08:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631489  13 58448 29256585 A  ERRORERROR'
2018-11-26 08:07:36 [DEBUG   ] Got command RPT from MCS: ref #631490
2018-11-26 08:07:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631490  77 58448 29256789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:07:36 [DEBUG   ] Got command RPT from MCS: ref #631491
2018-11-26 08:07:36 [DEBUG   ] summary = ERROR
2018-11-26 08:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631491  13 58448 29256993 A  ERRORERROR'
2018-11-26 08:07:37 [DEBUG   ] Got command RPT from MCS: ref #631492
2018-11-26 08:07:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631492  77 58448 29257185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:07:37 [DEBUG   ] Got command RPT from MCS: ref #631493
2018-11-26 08:07:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631493  12 58448 29257389 A  ERRORB—™š'
2018-11-26 08:07:39 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-26 08:07:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 08:08:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:08:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:08:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:08:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:08:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:08:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:08:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:08:23 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-26 08:08:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:08:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:09:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:09:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:09:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 08:09:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:09:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:09:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:09:23 [WARNING ] (13, 1, 'bot')
2018-11-26 08:09:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:09:23 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-11-26 08:09:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:09:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:10:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:10:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:10:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:10:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:10:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:10:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:10:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:10:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:10:24 [DEBUG   ] Finished updating board flags in 2.231 seconds
2018-11-26 08:10:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 08:10:48 [DEBUG   ] Got command RPT from MCS: ref #631498
2018-11-26 08:10:48 [DEBUG   ] summary = ERROR
2018-11-26 08:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631498  13 58448 29448637 A  ERRORERROR'
2018-11-26 08:10:48 [DEBUG   ] Got command RPT from MCS: ref #631499
2018-11-26 08:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631499  77 58448 29448638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:10:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:11:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:11:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:11:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:11:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:11:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:11:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:11:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:11:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:11:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:11:24 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-11-26 08:11:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:11:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:12:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:12:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:12:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:12:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:12:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:12:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:12:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:12:24 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-11-26 08:12:36 [DEBUG   ] Got command RPT from MCS: ref #631517
2018-11-26 08:12:36 [DEBUG   ] summary = ERROR
2018-11-26 08:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631517  13 58448 29556661 A  ERRORERROR'
2018-11-26 08:12:36 [DEBUG   ] Got command RPT from MCS: ref #631518
2018-11-26 08:12:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631518  77 58448 29556865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:12:37 [DEBUG   ] Got command RPT from MCS: ref #631519
2018-11-26 08:12:37 [DEBUG   ] summary = ERROR
2018-11-26 08:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631519  13 58448 29557069 A  ERRORERROR'
2018-11-26 08:12:37 [DEBUG   ] Got command RPT from MCS: ref #631521
2018-11-26 08:12:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631521  77 58448 29557273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:12:37 [DEBUG   ] Got command RPT from MCS: ref #631522
2018-11-26 08:12:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631522  12 58448 29557465 A  ERRORB—™š'
2018-11-26 08:12:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:12:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 08:13:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:13:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:13:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:13:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:13:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:13:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:13:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:13:24 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-11-26 08:13:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:13:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:14:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:14:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:14:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:14:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:14:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:14:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:14:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:14:24 [DEBUG   ] Finished updating board flags in 1.893 seconds
2018-11-26 08:14:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:14:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:15:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:15:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:15:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:15:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:15:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:15:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:15:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:15:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:15:24 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-11-26 08:15:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:15:48 [DEBUG   ] Got command RPT from MCS: ref #631535
2018-11-26 08:15:48 [DEBUG   ] summary = ERROR
2018-11-26 08:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631535  13 58448 29748645 A  ERRORERROR'
2018-11-26 08:15:48 [DEBUG   ] Got command RPT from MCS: ref #631536
2018-11-26 08:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631536  77 58448 29748646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:15:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:16:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:16:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:16:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:16:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:16:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:16:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:16:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:16:24 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-26 08:16:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:16:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:17:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:17:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:17:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:17:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:17:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:17:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:17:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:17:25 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-11-26 08:17:36 [DEBUG   ] Got command RPT from MCS: ref #631552
2018-11-26 08:17:36 [DEBUG   ] summary = ERROR
2018-11-26 08:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631552  13 58448 29856741 A  ERRORERROR'
2018-11-26 08:17:36 [DEBUG   ] Got command RPT from MCS: ref #631553
2018-11-26 08:17:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631553  77 58448 29856945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:17:37 [DEBUG   ] Got command RPT from MCS: ref #631554
2018-11-26 08:17:37 [DEBUG   ] summary = ERROR
2018-11-26 08:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631554  13 58448 29857149 A  ERRORERROR'
2018-11-26 08:17:37 [DEBUG   ] Got command RPT from MCS: ref #631555
2018-11-26 08:17:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631555  77 58448 29857353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:17:37 [DEBUG   ] Got command RPT from MCS: ref #631556
2018-11-26 08:17:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631556  12 58448 29857545 A  ERRORB–™š'
2018-11-26 08:17:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:17:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:18:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:18:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:18:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:18:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:18:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:18:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:18:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:18:24 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-11-26 08:18:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:18:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:19:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:19:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:19:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:19:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:19:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:19:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:19:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:19:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:19:24 [DEBUG   ] Finished updating board flags in 1.675 seconds
2018-11-26 08:19:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:19:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:20:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:20:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:20:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:20:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:20:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:20:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:20:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:20:24 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-11-26 08:20:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:20:48 [DEBUG   ] Got command RPT from MCS: ref #631561
2018-11-26 08:20:48 [DEBUG   ] summary = ERROR
2018-11-26 08:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631561  13 58448 30048641 A  ERRORERROR'
2018-11-26 08:20:48 [DEBUG   ] Got command RPT from MCS: ref #631562
2018-11-26 08:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631562  77 58448 30048642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:20:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:21:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:21:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:21:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:21:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:21:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:21:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:21:25 [DEBUG   ] Finished updating board flags in 1.881 seconds
2018-11-26 08:21:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:21:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:22:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:22:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:22:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:22:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:22:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:22:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:22:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:22:24 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-26 08:22:36 [DEBUG   ] Got command RPT from MCS: ref #631584
2018-11-26 08:22:36 [DEBUG   ] summary = ERROR
2018-11-26 08:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631584  13 58448 30156825 A  ERRORERROR'
2018-11-26 08:22:37 [DEBUG   ] Got command RPT from MCS: ref #631585
2018-11-26 08:22:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631585  77 58448 30157029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:22:37 [DEBUG   ] Got command RPT from MCS: ref #631586
2018-11-26 08:22:37 [DEBUG   ] summary = ERROR
2018-11-26 08:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631586  13 58448 30157233 A  ERRORERROR'
2018-11-26 08:22:37 [DEBUG   ] Got command RPT from MCS: ref #631588
2018-11-26 08:22:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631588  77 58448 30157425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:22:37 [DEBUG   ] Got command RPT from MCS: ref #631589
2018-11-26 08:22:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631589  12 58448 30157629 A  ERRORB•™š'
2018-11-26 08:22:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:22:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:23:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:23:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:23:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:23:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:23:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:23:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:23:24 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-11-26 08:23:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 08:23:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:24:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:24:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 08:24:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:24:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:24:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:24:24 [WARNING ] (13, 1, 'bot')
2018-11-26 08:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:24:24 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-11-26 08:24:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:24:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:25:19 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-26 08:25:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:25:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:25:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:25:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:25:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:25:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:25:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:25:25 [DEBUG   ] Finished updating board flags in 2.285 seconds
2018-11-26 08:25:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 08:25:48 [DEBUG   ] Got command RPT from MCS: ref #631598
2018-11-26 08:25:48 [DEBUG   ] summary = ERROR
2018-11-26 08:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631598  13 58448 30348649 A  ERRORERROR'
2018-11-26 08:25:48 [DEBUG   ] Got command RPT from MCS: ref #631599
2018-11-26 08:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631599  77 58448 30348650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:25:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 08:26:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 08:26:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:26:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 08:26:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:26:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:26:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:26:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:26:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:26:25 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-11-26 08:26:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 08:26:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:27:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 08:27:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:27:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:27:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:27:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:27:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:27:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:27:25 [DEBUG   ] Finished updating board flags in 1.900 seconds
2018-11-26 08:27:36 [DEBUG   ] Got command RPT from MCS: ref #631615
2018-11-26 08:27:36 [DEBUG   ] summary = ERROR
2018-11-26 08:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631615  13 58448 30456909 A  ERRORERROR'
2018-11-26 08:27:37 [DEBUG   ] Got command RPT from MCS: ref #631616
2018-11-26 08:27:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631616  77 58448 30457113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:27:37 [DEBUG   ] Got command RPT from MCS: ref #631617
2018-11-26 08:27:37 [DEBUG   ] summary = ERROR
2018-11-26 08:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631617  13 58448 30457305 A  ERRORERROR'
2018-11-26 08:27:37 [DEBUG   ] Got command RPT from MCS: ref #631618
2018-11-26 08:27:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631618  77 58448 30457509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:27:37 [DEBUG   ] Got command RPT from MCS: ref #631619
2018-11-26 08:27:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631619  12 58448 30457713 A  ERRORB—™š'
2018-11-26 08:27:39 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-26 08:27:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:28:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 08:28:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:28:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:28:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:28:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:28:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:28:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:28:25 [DEBUG   ] Finished updating board flags in 1.706 seconds
2018-11-26 08:28:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:28:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:29:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:29:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:29:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:29:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:29:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:29:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:29:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:29:25 [DEBUG   ] Finished updating board flags in 1.704 seconds
2018-11-26 08:29:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 08:29:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:30:19 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-26 08:30:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:30:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:30:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:30:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:30:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:30:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:30:25 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-11-26 08:30:40 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 08:30:48 [DEBUG   ] Got command RPT from MCS: ref #631628
2018-11-26 08:30:48 [DEBUG   ] summary = ERROR
2018-11-26 08:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631628  13 58448 30648641 A  ERRORERROR'
2018-11-26 08:30:48 [DEBUG   ] Got command RPT from MCS: ref #631629
2018-11-26 08:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631629  77 58448 30648642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:31:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 08:31:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:31:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:31:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:31:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:31:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:31:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:31:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:31:25 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-26 08:31:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:32:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:32:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:32:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:32:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:32:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:32:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:32:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:32:25 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-26 08:32:36 [DEBUG   ] Got command RPT from MCS: ref #631647
2018-11-26 08:32:36 [DEBUG   ] summary = ERROR
2018-11-26 08:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631647  13 58448 30756989 A  ERRORERROR'
2018-11-26 08:32:37 [DEBUG   ] Got command RPT from MCS: ref #631648
2018-11-26 08:32:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631648  77 58448 30757193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:32:37 [DEBUG   ] Got command RPT from MCS: ref #631649
2018-11-26 08:32:37 [DEBUG   ] summary = ERROR
2018-11-26 08:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631649  13 58448 30757385 A  ERRORERROR'
2018-11-26 08:32:37 [DEBUG   ] Got command RPT from MCS: ref #631651
2018-11-26 08:32:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631651  77 58448 30757589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:32:37 [DEBUG   ] Got command RPT from MCS: ref #631652
2018-11-26 08:32:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631652  12 58448 30757793 A  ERRORB—™š'
2018-11-26 08:32:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:33:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:33:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:33:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:33:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:33:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:33:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:33:25 [WARNING ] (13, 1, 'bot')
2018-11-26 08:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:33:25 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-11-26 08:33:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 08:34:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 08:34:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 08:34:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:34:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:34:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:34:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:34:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:34:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:34:26 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-11-26 08:34:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 08:35:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 08:35:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 08:35:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:35:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:35:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:35:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:35:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:35:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:35:26 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-11-26 08:35:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 08:35:48 [DEBUG   ] Got command RPT from MCS: ref #631661
2018-11-26 08:35:48 [DEBUG   ] summary = ERROR
2018-11-26 08:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631661  13 58448 30948653 A  ERRORERROR'
2018-11-26 08:35:48 [DEBUG   ] Got command RPT from MCS: ref #631662
2018-11-26 08:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631662  77 58448 30948654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:36:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:36:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 08:36:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:36:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:36:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:36:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:36:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:36:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:36:26 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-26 08:36:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 08:37:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 08:37:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:37:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:37:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:37:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:37:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:37:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:37:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:37:26 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-11-26 08:37:37 [DEBUG   ] Got command RPT from MCS: ref #631682
2018-11-26 08:37:37 [DEBUG   ] summary = ERROR
2018-11-26 08:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631682  13 58448 31057065 A  ERRORERROR'
2018-11-26 08:37:37 [DEBUG   ] Got command RPT from MCS: ref #631683
2018-11-26 08:37:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631683  77 58448 31057269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:37:37 [DEBUG   ] Got command RPT from MCS: ref #631684
2018-11-26 08:37:37 [DEBUG   ] summary = ERROR
2018-11-26 08:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631684  13 58448 31057473 A  ERRORERROR'
2018-11-26 08:37:37 [DEBUG   ] Got command RPT from MCS: ref #631685
2018-11-26 08:37:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631685  77 58448 31057665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:37:37 [DEBUG   ] Got command RPT from MCS: ref #631686
2018-11-26 08:37:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631686  12 58448 31057869 A  ERRORB–™š'
2018-11-26 08:37:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 08:38:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 08:38:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 08:38:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:38:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:38:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:38:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:38:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:38:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:38:26 [DEBUG   ] Finished updating board flags in 1.706 seconds
2018-11-26 08:38:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:39:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 08:39:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 08:39:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:39:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:39:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:39:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:39:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:39:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:39:26 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-11-26 08:39:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:40:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 08:40:20 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-26 08:40:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:40:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:40:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:40:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:40:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:40:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:40:26 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-26 08:40:41 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 08:40:48 [DEBUG   ] Got command RPT from MCS: ref #631691
2018-11-26 08:40:48 [DEBUG   ] summary = ERROR
2018-11-26 08:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631691  13 58448 31248653 A  ERRORERROR'
2018-11-26 08:40:48 [DEBUG   ] Got command RPT from MCS: ref #631692
2018-11-26 08:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631692  77 58448 31248654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:41:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-11-26 08:41:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 08:41:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:41:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:41:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:41:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:41:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:41:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:41:26 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-26 08:41:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 08:42:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 08:42:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 08:42:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:42:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:42:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:42:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:42:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:42:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:42:26 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-11-26 08:42:37 [DEBUG   ] Got command RPT from MCS: ref #631710
2018-11-26 08:42:37 [DEBUG   ] summary = ERROR
2018-11-26 08:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631710  13 58448 31357145 A  ERRORERROR'
2018-11-26 08:42:37 [DEBUG   ] Got command RPT from MCS: ref #631711
2018-11-26 08:42:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631711  77 58448 31357349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:42:37 [DEBUG   ] Got command RPT from MCS: ref #631712
2018-11-26 08:42:37 [DEBUG   ] summary = ERROR
2018-11-26 08:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631712  13 58448 31357541 A  ERRORERROR'
2018-11-26 08:42:37 [DEBUG   ] Got command RPT from MCS: ref #631714
2018-11-26 08:42:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631714  77 58448 31357745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:42:37 [DEBUG   ] Got command RPT from MCS: ref #631715
2018-11-26 08:42:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631715  12 58448 31357949 A  ERRORB•™š'
2018-11-26 08:42:41 [DEBUG   ] Finished updating ant stats in 0.789 seconds
2018-11-26 08:43:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-26 08:43:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 08:43:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:43:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:43:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:43:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:43:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:43:26 [WARNING ] (13, 1, 'bot')
2018-11-26 08:43:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:43:26 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-26 08:43:42 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 08:44:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 08:44:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:44:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:44:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:44:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:44:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:44:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:44:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:44:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:44:27 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-11-26 08:44:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:45:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 08:45:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:45:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:45:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:45:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:45:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:45:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:45:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:45:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:45:27 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-11-26 08:45:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:45:48 [DEBUG   ] Got command RPT from MCS: ref #631728
2018-11-26 08:45:48 [DEBUG   ] summary = ERROR
2018-11-26 08:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631728  13 58448 31548653 A  ERRORERROR'
2018-11-26 08:45:48 [DEBUG   ] Got command RPT from MCS: ref #631729
2018-11-26 08:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631729  77 58448 31548654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:46:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:46:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:46:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:46:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:46:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:46:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:46:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:46:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:46:27 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-26 08:46:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:47:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:47:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:47:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:47:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:47:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:47:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:47:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:47:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:47:27 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-11-26 08:47:37 [DEBUG   ] Got command RPT from MCS: ref #631745
2018-11-26 08:47:37 [DEBUG   ] summary = ERROR
2018-11-26 08:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631745  13 58448 31657221 A  ERRORERROR'
2018-11-26 08:47:37 [DEBUG   ] Got command RPT from MCS: ref #631746
2018-11-26 08:47:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631746  77 58448 31657425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:47:37 [DEBUG   ] Got command RPT from MCS: ref #631747
2018-11-26 08:47:37 [DEBUG   ] summary = ERROR
2018-11-26 08:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631747  13 58448 31657629 A  ERRORERROR'
2018-11-26 08:47:37 [DEBUG   ] Got command RPT from MCS: ref #631748
2018-11-26 08:47:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631748  77 58448 31657833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:47:38 [DEBUG   ] Got command RPT from MCS: ref #631749
2018-11-26 08:47:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631749  12 58448 31658025 A  ERRORB—™š'
2018-11-26 08:47:42 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-26 08:48:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 08:48:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 08:48:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:48:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:48:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:48:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:48:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:48:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:48:27 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-11-26 08:48:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 08:49:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 08:49:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 08:49:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 08:49:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:49:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 08:49:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:49:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:49:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:49:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:49:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:49:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:49:27 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-26 08:49:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:50:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 08:50:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 08:50:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:50:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:50:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:50:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:50:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:50:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:50:27 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-11-26 08:50:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 08:50:48 [DEBUG   ] Got command RPT from MCS: ref #631754
2018-11-26 08:50:48 [DEBUG   ] summary = ERROR
2018-11-26 08:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631754  13 58448 31848653 A  ERRORERROR'
2018-11-26 08:50:48 [DEBUG   ] Got command RPT from MCS: ref #631755
2018-11-26 08:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631755  77 58448 31848654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:51:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 08:51:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 08:51:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:51:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:51:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:51:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:51:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:51:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:51:27 [DEBUG   ] Finished updating board flags in 1.696 seconds
2018-11-26 08:51:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:52:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:52:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 08:52:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 08:52:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:52:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:52:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:52:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:52:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:52:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:52:27 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-26 08:52:37 [DEBUG   ] Got command RPT from MCS: ref #631777
2018-11-26 08:52:37 [DEBUG   ] summary = ERROR
2018-11-26 08:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631777  13 58448 31957305 A  ERRORERROR'
2018-11-26 08:52:37 [DEBUG   ] Got command RPT from MCS: ref #631778
2018-11-26 08:52:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631778  77 58448 31957509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:52:37 [DEBUG   ] Got command RPT from MCS: ref #631779
2018-11-26 08:52:37 [DEBUG   ] summary = ERROR
2018-11-26 08:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631779  13 58448 31957713 A  ERRORERROR'
2018-11-26 08:52:37 [DEBUG   ] Got command RPT from MCS: ref #631781
2018-11-26 08:52:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631781  77 58448 31957905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:52:38 [DEBUG   ] Got command RPT from MCS: ref #631782
2018-11-26 08:52:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631782  12 58448 31958109 A  ERRORB–™š'
2018-11-26 08:52:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:53:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:53:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:53:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:53:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:53:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:53:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:53:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:53:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:53:27 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-11-26 08:53:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 08:54:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:54:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:54:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:54:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:54:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:54:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:54:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:54:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:54:27 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-11-26 08:54:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 08:55:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 08:55:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:55:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:55:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:55:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:55:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:55:27 [WARNING ] (13, 1, 'bot')
2018-11-26 08:55:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:55:27 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-26 08:55:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 08:55:48 [DEBUG   ] Got command RPT from MCS: ref #631791
2018-11-26 08:55:48 [DEBUG   ] summary = ERROR
2018-11-26 08:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631791  13 58448 32148657 A  ERRORERROR'
2018-11-26 08:55:48 [DEBUG   ] Got command RPT from MCS: ref #631792
2018-11-26 08:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631792  77 58448 32148658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:56:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 08:56:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 08:56:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:56:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:56:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:56:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:56:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:56:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:56:28 [DEBUG   ] Finished updating board flags in 2.260 seconds
2018-11-26 08:56:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 08:57:03 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 08:57:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 08:57:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:57:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:57:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:57:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:57:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:57:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:57:28 [DEBUG   ] Finished updating board flags in 2.082 seconds
2018-11-26 08:57:37 [DEBUG   ] Got command RPT from MCS: ref #631808
2018-11-26 08:57:37 [DEBUG   ] summary = ERROR
2018-11-26 08:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631808  13 58448 32257393 A  ERRORERROR'
2018-11-26 08:57:37 [DEBUG   ] Got command RPT from MCS: ref #631809
2018-11-26 08:57:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631809  77 58448 32257585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:57:37 [DEBUG   ] Got command RPT from MCS: ref #631810
2018-11-26 08:57:37 [DEBUG   ] summary = ERROR
2018-11-26 08:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631810  13 58448 32257789 A  ERRORERROR'
2018-11-26 08:57:37 [DEBUG   ] Got command RPT from MCS: ref #631811
2018-11-26 08:57:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 08:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631811  77 58448 32257993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 08:57:38 [DEBUG   ] Got command RPT from MCS: ref #631812
2018-11-26 08:57:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 08:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631812  12 58448 32258185 A  ERRORB•™š'
2018-11-26 08:57:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:58:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 08:58:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:58:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:58:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:58:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:58:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:58:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:58:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:58:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:58:28 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-26 08:58:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 08:59:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 08:59:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 08:59:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 08:59:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 08:59:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:59:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:59:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:59:28 [WARNING ] (13, 1, 'bot')
2018-11-26 08:59:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 08:59:28 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-11-26 08:59:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 09:00:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 09:00:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 09:00:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:00:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 09:00:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:00:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:00:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:00:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:00:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:00:28 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-26 09:00:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:00:48 [DEBUG   ] Got command RPT from MCS: ref #631821
2018-11-26 09:00:48 [DEBUG   ] summary = ERROR
2018-11-26 09:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631821  13 58448 32448657 A  ERRORERROR'
2018-11-26 09:00:48 [DEBUG   ] Got command RPT from MCS: ref #631822
2018-11-26 09:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631822  77 58448 32448658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:01:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:01:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:01:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 09:01:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:01:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:01:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:01:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:01:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:01:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:01:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:01:28 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-26 09:01:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:02:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:02:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:02:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:02:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-26 09:02:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:02:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:02:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:02:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:02:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:02:28 [DEBUG   ] Finished updating board flags in 1.695 seconds
2018-11-26 09:02:37 [DEBUG   ] Got command RPT from MCS: ref #631840
2018-11-26 09:02:37 [DEBUG   ] summary = ERROR
2018-11-26 09:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631840  13 58448 32557469 A  ERRORERROR'
2018-11-26 09:02:37 [DEBUG   ] Got command RPT from MCS: ref #631841
2018-11-26 09:02:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631841  77 58448 32557673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:02:37 [DEBUG   ] Got command RPT from MCS: ref #631842
2018-11-26 09:02:37 [DEBUG   ] summary = ERROR
2018-11-26 09:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631842  13 58448 32557865 A  ERRORERROR'
2018-11-26 09:02:38 [DEBUG   ] Got command RPT from MCS: ref #631844
2018-11-26 09:02:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631844  77 58448 32558069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:02:38 [DEBUG   ] Got command RPT from MCS: ref #631845
2018-11-26 09:02:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631845  12 58448 32558273 A  ERRORB–™š'
2018-11-26 09:02:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:03:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:03:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:03:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:03:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 09:03:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:03:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:03:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:03:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:03:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:03:28 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-11-26 09:03:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:04:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:04:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:04:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:04:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:04:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:04:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:04:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:04:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:04:28 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-11-26 09:04:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:05:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:05:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:05:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:05:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:05:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:05:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:05:28 [WARNING ] (13, 1, 'bot')
2018-11-26 09:05:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:05:28 [DEBUG   ] Finished updating board flags in 1.532 seconds
2018-11-26 09:05:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:05:48 [DEBUG   ] Got command RPT from MCS: ref #631854
2018-11-26 09:05:48 [DEBUG   ] summary = ERROR
2018-11-26 09:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631854  13 58448 32748649 A  ERRORERROR'
2018-11-26 09:05:48 [DEBUG   ] Got command RPT from MCS: ref #631855
2018-11-26 09:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631855  77 58448 32748650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:06:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:06:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:06:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:06:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 09:06:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:06:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:06:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:06:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:06:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:06:29 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-11-26 09:06:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:07:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:07:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:07:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:07:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:07:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:07:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:07:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:07:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:07:29 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-11-26 09:07:37 [DEBUG   ] Got command RPT from MCS: ref #631875
2018-11-26 09:07:37 [DEBUG   ] summary = ERROR
2018-11-26 09:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631875  13 58448 32857545 A  ERRORERROR'
2018-11-26 09:07:37 [DEBUG   ] Got command RPT from MCS: ref #631876
2018-11-26 09:07:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631876  77 58448 32857749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:07:37 [DEBUG   ] Got command RPT from MCS: ref #631877
2018-11-26 09:07:37 [DEBUG   ] summary = ERROR
2018-11-26 09:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631877  13 58448 32857953 A  ERRORERROR'
2018-11-26 09:07:38 [DEBUG   ] Got command RPT from MCS: ref #631878
2018-11-26 09:07:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631878  77 58448 32858145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:07:38 [DEBUG   ] Got command RPT from MCS: ref #631879
2018-11-26 09:07:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631879  12 58448 32858349 A  ERRORB—™š'
2018-11-26 09:07:43 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-26 09:08:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 09:08:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:08:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:08:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:08:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:08:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:08:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:08:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:08:29 [DEBUG   ] Finished updating board flags in 1.891 seconds
2018-11-26 09:08:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 09:09:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 09:09:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 09:09:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:09:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:09:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:09:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:09:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:09:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:09:29 [DEBUG   ] Finished updating board flags in 1.838 seconds
2018-11-26 09:09:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:10:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 09:10:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:10:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:10:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:10:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:10:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:10:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:10:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:10:29 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-26 09:10:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 09:10:48 [DEBUG   ] Got command RPT from MCS: ref #631884
2018-11-26 09:10:48 [DEBUG   ] summary = ERROR
2018-11-26 09:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631884  13 58448 33048657 A  ERRORERROR'
2018-11-26 09:10:48 [DEBUG   ] Got command RPT from MCS: ref #631885
2018-11-26 09:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631885  77 58448 33048658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:11:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:11:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:11:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:11:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:11:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:11:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:11:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:11:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:11:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:11:29 [DEBUG   ] Finished updating board flags in 1.750 seconds
2018-11-26 09:11:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:12:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:12:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:12:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:12:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:12:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:12:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:12:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:12:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:12:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:12:29 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-11-26 09:12:37 [DEBUG   ] Got command RPT from MCS: ref #631903
2018-11-26 09:12:37 [DEBUG   ] summary = ERROR
2018-11-26 09:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631903  13 58448 33157625 A  ERRORERROR'
2018-11-26 09:12:37 [DEBUG   ] Got command RPT from MCS: ref #631904
2018-11-26 09:12:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631904  77 58448 33157829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:12:38 [DEBUG   ] Got command RPT from MCS: ref #631905
2018-11-26 09:12:38 [DEBUG   ] summary = ERROR
2018-11-26 09:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631905  13 58448 33158033 A  ERRORERROR'
2018-11-26 09:12:38 [DEBUG   ] Got command RPT from MCS: ref #631907
2018-11-26 09:12:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631907  77 58448 33158225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:12:38 [DEBUG   ] Got command RPT from MCS: ref #631909
2018-11-26 09:12:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631909  12 58448 33158429 A  ERRORB–™š'
2018-11-26 09:12:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:13:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:13:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:13:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:13:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:13:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:13:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:13:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:13:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:13:29 [DEBUG   ] Finished updating board flags in 1.676 seconds
2018-11-26 09:13:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:14:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:14:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:14:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:14:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 09:14:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:14:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:14:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:14:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:14:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:14:29 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-11-26 09:14:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:15:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:15:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:15:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:15:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:15:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:15:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:15:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:15:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:15:29 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-11-26 09:15:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:15:48 [DEBUG   ] Got command RPT from MCS: ref #631921
2018-11-26 09:15:48 [DEBUG   ] summary = ERROR
2018-11-26 09:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631921  13 58448 33348653 A  ERRORERROR'
2018-11-26 09:15:48 [DEBUG   ] Got command RPT from MCS: ref #631922
2018-11-26 09:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631922  77 58448 33348654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:16:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:16:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:16:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:16:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:16:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:16:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:16:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:16:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:16:29 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-11-26 09:16:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:17:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:17:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:17:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:17:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:17:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:17:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:17:29 [WARNING ] (13, 1, 'bot')
2018-11-26 09:17:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:17:29 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-11-26 09:17:37 [DEBUG   ] Got command RPT from MCS: ref #631938
2018-11-26 09:17:37 [DEBUG   ] summary = ERROR
2018-11-26 09:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631938  13 58448 33457709 A  ERRORERROR'
2018-11-26 09:17:37 [DEBUG   ] Got command RPT from MCS: ref #631939
2018-11-26 09:17:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631939  77 58448 33457901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:17:38 [DEBUG   ] Got command RPT from MCS: ref #631940
2018-11-26 09:17:38 [DEBUG   ] summary = ERROR
2018-11-26 09:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631940  13 58448 33458105 A  ERRORERROR'
2018-11-26 09:17:38 [DEBUG   ] Got command RPT from MCS: ref #631941
2018-11-26 09:17:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631941  77 58448 33458309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:17:38 [DEBUG   ] Got command RPT from MCS: ref #631942
2018-11-26 09:17:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631942  12 58448 33458513 A  ERRORB•™š'
2018-11-26 09:17:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:18:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:18:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:18:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:18:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:18:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:18:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:18:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:18:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:18:30 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-11-26 09:18:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:19:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:19:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:19:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:19:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:19:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:19:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:19:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:19:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:19:30 [DEBUG   ] Finished updating board flags in 2.147 seconds
2018-11-26 09:19:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:20:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:20:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:20:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:20:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:20:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:20:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:20:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:20:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:20:30 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-11-26 09:20:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:20:48 [DEBUG   ] Got command RPT from MCS: ref #631947
2018-11-26 09:20:48 [DEBUG   ] summary = ERROR
2018-11-26 09:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631947  13 58448 33648657 A  ERRORERROR'
2018-11-26 09:20:48 [DEBUG   ] Got command RPT from MCS: ref #631948
2018-11-26 09:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631948  77 58448 33648658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:21:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:21:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:21:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:21:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:21:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:21:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:21:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:21:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:21:30 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-26 09:21:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:22:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:22:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:22:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:22:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:22:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:22:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:22:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:22:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:22:30 [DEBUG   ] Finished updating board flags in 1.956 seconds
2018-11-26 09:22:37 [DEBUG   ] Got command RPT from MCS: ref #631970
2018-11-26 09:22:37 [DEBUG   ] summary = ERROR
2018-11-26 09:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631970  13 58448 33757781 A  ERRORERROR'
2018-11-26 09:22:37 [DEBUG   ] Got command RPT from MCS: ref #631971
2018-11-26 09:22:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631971  77 58448 33757985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:22:38 [DEBUG   ] Got command RPT from MCS: ref #631972
2018-11-26 09:22:38 [DEBUG   ] summary = ERROR
2018-11-26 09:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631972  13 58448 33758189 A  ERRORERROR'
2018-11-26 09:22:38 [DEBUG   ] Got command RPT from MCS: ref #631974
2018-11-26 09:22:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631974  77 58448 33758393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:22:38 [DEBUG   ] Got command RPT from MCS: ref #631975
2018-11-26 09:22:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631975  12 58448 33758585 A  ERRORB—™š'
2018-11-26 09:22:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:23:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:23:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:23:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:23:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:23:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:23:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:23:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:23:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:23:30 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-11-26 09:23:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:24:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:24:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 09:24:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:24:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:24:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:24:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:24:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:24:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:24:30 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-26 09:24:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-26 09:25:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 09:25:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 09:25:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:25:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:25:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:25:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:25:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:25:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:25:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:25:30 [DEBUG   ] Finished updating board flags in 1.764 seconds
2018-11-26 09:25:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 09:25:48 [DEBUG   ] Got command RPT from MCS: ref #631984
2018-11-26 09:25:48 [DEBUG   ] summary = ERROR
2018-11-26 09:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631984  13 58448 33948661 A  ERRORERROR'
2018-11-26 09:25:48 [DEBUG   ] Got command RPT from MCS: ref #631985
2018-11-26 09:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   631985  77 58448 33948662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:26:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 09:26:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 09:26:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:26:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:26:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:26:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:26:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:26:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:26:30 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-26 09:26:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:27:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:27:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:27:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:27:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:27:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:27:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:27:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:27:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:27:30 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-26 09:27:37 [DEBUG   ] Got command RPT from MCS: ref #632001
2018-11-26 09:27:37 [DEBUG   ] summary = ERROR
2018-11-26 09:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632001  13 58448 34057869 A  ERRORERROR'
2018-11-26 09:27:38 [DEBUG   ] Got command RPT from MCS: ref #632002
2018-11-26 09:27:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632002  77 58448 34058061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:27:38 [DEBUG   ] Got command RPT from MCS: ref #632003
2018-11-26 09:27:38 [DEBUG   ] summary = ERROR
2018-11-26 09:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632003  13 58448 34058265 A  ERRORERROR'
2018-11-26 09:27:38 [DEBUG   ] Got command RPT from MCS: ref #632004
2018-11-26 09:27:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632004  77 58448 34058469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:27:38 [DEBUG   ] Got command RPT from MCS: ref #632005
2018-11-26 09:27:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632005  12 58448 34058661 A  ERRORB—™š'
2018-11-26 09:27:44 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-11-26 09:28:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 09:28:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:28:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:28:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:28:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:28:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:28:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:28:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:28:30 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-11-26 09:28:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:29:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:29:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:29:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:29:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:29:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:29:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:29:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:29:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:29:30 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-11-26 09:29:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:30:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:30:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:30:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:30:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 09:30:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:30:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:30:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:30:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:30:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:30:30 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-26 09:30:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 09:30:48 [DEBUG   ] Got command RPT from MCS: ref #632014
2018-11-26 09:30:48 [DEBUG   ] summary = ERROR
2018-11-26 09:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632014  13 58448 34248661 A  ERRORERROR'
2018-11-26 09:30:48 [DEBUG   ] Got command RPT from MCS: ref #632015
2018-11-26 09:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632015  77 58448 34248662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:31:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 09:31:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 09:31:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:31:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:31:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:31:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:31:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:31:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:31:30 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-26 09:31:45 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-26 09:32:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:32:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:32:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:32:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:32:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:32:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:32:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:32:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:32:30 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-26 09:32:37 [DEBUG   ] Got command RPT from MCS: ref #632033
2018-11-26 09:32:37 [DEBUG   ] summary = ERROR
2018-11-26 09:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632033  13 58448 34357941 A  ERRORERROR'
2018-11-26 09:32:38 [DEBUG   ] Got command RPT from MCS: ref #632034
2018-11-26 09:32:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632034  77 58448 34358145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:32:38 [DEBUG   ] Got command RPT from MCS: ref #632035
2018-11-26 09:32:38 [DEBUG   ] summary = ERROR
2018-11-26 09:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632035  13 58448 34358349 A  ERRORERROR'
2018-11-26 09:32:38 [DEBUG   ] Got command RPT from MCS: ref #632037
2018-11-26 09:32:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632037  77 58448 34358541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:32:38 [DEBUG   ] Got command RPT from MCS: ref #632038
2018-11-26 09:32:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632038  12 58448 34358745 A  ERRORB•™š'
2018-11-26 09:32:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:33:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:33:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:33:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:33:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:33:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:33:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:33:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:33:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:33:30 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-11-26 09:33:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:34:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 09:34:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:34:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:34:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 09:34:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:34:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:34:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:34:30 [WARNING ] (13, 1, 'bot')
2018-11-26 09:34:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:34:30 [DEBUG   ] Finished updating board flags in 1.558 seconds
2018-11-26 09:34:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:35:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:35:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 09:35:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:35:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:35:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:35:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:35:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:35:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:35:31 [DEBUG   ] Finished updating board flags in 2.234 seconds
2018-11-26 09:35:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:35:48 [DEBUG   ] Got command RPT from MCS: ref #632047
2018-11-26 09:35:48 [DEBUG   ] summary = ERROR
2018-11-26 09:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632047  13 58448 34548661 A  ERRORERROR'
2018-11-26 09:35:48 [DEBUG   ] Got command RPT from MCS: ref #632048
2018-11-26 09:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632048  77 58448 34548662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:36:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:36:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:36:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:36:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:36:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:36:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:36:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:36:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:36:31 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-11-26 09:36:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 09:37:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 09:37:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:37:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:37:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 09:37:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:37:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:37:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:37:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:37:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:37:31 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-26 09:37:38 [DEBUG   ] Got command RPT from MCS: ref #632068
2018-11-26 09:37:38 [DEBUG   ] summary = ERROR
2018-11-26 09:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632068  13 58448 34658017 A  ERRORERROR'
2018-11-26 09:37:38 [DEBUG   ] Got command RPT from MCS: ref #632069
2018-11-26 09:37:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632069  77 58448 34658221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:37:38 [DEBUG   ] Got command RPT from MCS: ref #632070
2018-11-26 09:37:38 [DEBUG   ] summary = ERROR
2018-11-26 09:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632070  13 58448 34658425 A  ERRORERROR'
2018-11-26 09:37:38 [DEBUG   ] Got command RPT from MCS: ref #632071
2018-11-26 09:37:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632071  77 58448 34658617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:37:38 [DEBUG   ] Got command RPT from MCS: ref #632072
2018-11-26 09:37:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632072  12 58448 34658821 A  ERRORB•™š'
2018-11-26 09:37:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:38:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 09:38:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 09:38:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:38:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 09:38:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:38:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:38:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:38:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:38:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:38:31 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-26 09:38:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:39:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:39:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 09:39:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:39:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:39:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:39:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:39:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:39:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:39:31 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-11-26 09:39:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 09:40:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:40:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 09:40:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:40:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:40:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:40:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:40:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:40:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:40:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:40:31 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-11-26 09:40:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 09:40:48 [DEBUG   ] Got command RPT from MCS: ref #632077
2018-11-26 09:40:48 [DEBUG   ] summary = ERROR
2018-11-26 09:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632077  13 58448 34848665 A  ERRORERROR'
2018-11-26 09:40:48 [DEBUG   ] Got command RPT from MCS: ref #632078
2018-11-26 09:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632078  77 58448 34848666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:41:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:41:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:41:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:41:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:41:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:41:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:41:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:41:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:41:31 [DEBUG   ] Finished updating board flags in 1.883 seconds
2018-11-26 09:41:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 09:42:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:42:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:42:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:42:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 09:42:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:42:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:42:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:42:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:42:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:42:31 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-26 09:42:38 [DEBUG   ] Got command RPT from MCS: ref #632096
2018-11-26 09:42:38 [DEBUG   ] summary = ERROR
2018-11-26 09:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632096  13 58448 34958101 A  ERRORERROR'
2018-11-26 09:42:38 [DEBUG   ] Got command RPT from MCS: ref #632097
2018-11-26 09:42:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632097  77 58448 34958305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:42:38 [DEBUG   ] Got command RPT from MCS: ref #632098
2018-11-26 09:42:38 [DEBUG   ] summary = ERROR
2018-11-26 09:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632098  13 58448 34958497 A  ERRORERROR'
2018-11-26 09:42:38 [DEBUG   ] Got command RPT from MCS: ref #632100
2018-11-26 09:42:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632100  77 58448 34958701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:42:38 [DEBUG   ] Got command RPT from MCS: ref #632101
2018-11-26 09:42:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632101  12 58448 34958905 A  ERRORB—™š'
2018-11-26 09:42:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:43:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:43:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:43:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:43:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:43:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:43:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:43:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:43:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:43:31 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-11-26 09:43:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 09:44:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 09:44:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 09:44:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:44:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:44:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:44:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:44:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:44:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:44:31 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-11-26 09:44:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 09:45:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 09:45:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 09:45:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:45:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:45:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:45:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:45:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:45:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:45:31 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-11-26 09:45:46 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-26 09:45:48 [DEBUG   ] Got command RPT from MCS: ref #632114
2018-11-26 09:45:48 [DEBUG   ] summary = ERROR
2018-11-26 09:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632114  13 58448 35148661 A  ERRORERROR'
2018-11-26 09:45:48 [DEBUG   ] Got command RPT from MCS: ref #632115
2018-11-26 09:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632115  77 58448 35148662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:46:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:46:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:46:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:46:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:46:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:46:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:46:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:46:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:46:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:46:31 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-11-26 09:46:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 09:47:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 09:47:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:47:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:47:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:47:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:47:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:47:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:47:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:47:31 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-26 09:47:38 [DEBUG   ] Got command RPT from MCS: ref #632131
2018-11-26 09:47:38 [DEBUG   ] summary = ERROR
2018-11-26 09:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632131  13 58448 35258185 A  ERRORERROR'
2018-11-26 09:47:38 [DEBUG   ] Got command RPT from MCS: ref #632132
2018-11-26 09:47:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632132  77 58448 35258377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:47:38 [DEBUG   ] Got command RPT from MCS: ref #632133
2018-11-26 09:47:38 [DEBUG   ] summary = ERROR
2018-11-26 09:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632133  13 58448 35258581 A  ERRORERROR'
2018-11-26 09:47:38 [DEBUG   ] Got command RPT from MCS: ref #632134
2018-11-26 09:47:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632134  77 58448 35258785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:47:38 [DEBUG   ] Got command RPT from MCS: ref #632135
2018-11-26 09:47:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632135  12 58448 35258989 A  ERRORB—™š'
2018-11-26 09:47:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:48:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 09:48:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 09:48:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:48:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:48:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:48:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:48:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:48:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:48:31 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-11-26 09:48:46 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2018-11-26 09:49:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 09:49:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 09:49:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:49:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:49:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:49:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:49:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:49:31 [WARNING ] (13, 1, 'bot')
2018-11-26 09:49:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:49:31 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-26 09:49:47 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-26 09:50:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 09:50:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 09:50:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:50:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:50:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:50:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:50:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:50:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:50:32 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-11-26 09:50:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 09:50:48 [DEBUG   ] Got command RPT from MCS: ref #632140
2018-11-26 09:50:48 [DEBUG   ] summary = ERROR
2018-11-26 09:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632140  13 58448 35448665 A  ERRORERROR'
2018-11-26 09:50:48 [DEBUG   ] Got command RPT from MCS: ref #632141
2018-11-26 09:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632141  77 58448 35448666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:51:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 09:51:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 09:51:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:51:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:51:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:51:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:51:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:51:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:51:32 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-26 09:51:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 09:52:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 09:52:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:52:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:52:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 09:52:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:52:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:52:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:52:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:52:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:52:32 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-11-26 09:52:38 [DEBUG   ] Got command RPT from MCS: ref #632163
2018-11-26 09:52:38 [DEBUG   ] summary = ERROR
2018-11-26 09:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632163  13 58448 35558261 A  ERRORERROR'
2018-11-26 09:52:38 [DEBUG   ] Got command RPT from MCS: ref #632164
2018-11-26 09:52:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632164  77 58448 35558465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:52:38 [DEBUG   ] Got command RPT from MCS: ref #632165
2018-11-26 09:52:38 [DEBUG   ] summary = ERROR
2018-11-26 09:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632165  13 58448 35558657 A  ERRORERROR'
2018-11-26 09:52:38 [DEBUG   ] Got command RPT from MCS: ref #632167
2018-11-26 09:52:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632167  77 58448 35558861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:52:39 [DEBUG   ] Got command RPT from MCS: ref #632168
2018-11-26 09:52:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632168  12 58448 35559065 A  ERRORB–™š'
2018-11-26 09:52:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:53:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:53:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:53:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:53:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:53:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:53:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:53:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:53:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:53:32 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-26 09:53:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 09:54:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:54:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 09:54:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:54:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:54:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:54:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:54:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:54:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:54:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:54:32 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-26 09:54:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:55:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 09:55:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 09:55:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:55:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:55:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:55:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:55:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:55:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:55:32 [DEBUG   ] Finished updating board flags in 1.841 seconds
2018-11-26 09:55:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 09:55:48 [DEBUG   ] Got command RPT from MCS: ref #632177
2018-11-26 09:55:48 [DEBUG   ] summary = ERROR
2018-11-26 09:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632177  13 58448 35748669 A  ERRORERROR'
2018-11-26 09:55:48 [DEBUG   ] Got command RPT from MCS: ref #632178
2018-11-26 09:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632178  77 58448 35748670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:56:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 09:56:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:56:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:56:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:56:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:56:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:56:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:56:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:56:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:56:32 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-11-26 09:56:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 09:57:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 09:57:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 09:57:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:57:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:57:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:57:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:57:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:57:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:57:32 [DEBUG   ] Finished updating board flags in 1.685 seconds
2018-11-26 09:57:38 [DEBUG   ] Got command RPT from MCS: ref #632194
2018-11-26 09:57:38 [DEBUG   ] summary = ERROR
2018-11-26 09:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632194  13 58448 35858337 A  ERRORERROR'
2018-11-26 09:57:38 [DEBUG   ] Got command RPT from MCS: ref #632195
2018-11-26 09:57:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632195  77 58448 35858541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:57:38 [DEBUG   ] Got command RPT from MCS: ref #632196
2018-11-26 09:57:38 [DEBUG   ] summary = ERROR
2018-11-26 09:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632196  13 58448 35858745 A  ERRORERROR'
2018-11-26 09:57:38 [DEBUG   ] Got command RPT from MCS: ref #632197
2018-11-26 09:57:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 09:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632197  77 58448 35858937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 09:57:39 [DEBUG   ] Got command RPT from MCS: ref #632198
2018-11-26 09:57:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 09:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632198  12 58448 35859141 A  ERRORB–™š'
2018-11-26 09:57:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:58:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 09:58:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 09:58:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 09:58:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 09:58:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:58:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:58:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:58:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:58:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:58:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:58:32 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-11-26 09:58:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 09:59:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:59:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 09:59:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 09:59:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:59:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:59:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:59:32 [WARNING ] (13, 1, 'bot')
2018-11-26 09:59:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 09:59:32 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-11-26 09:59:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:00:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:00:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:00:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:00:32 [WARNING ] (13, 1, 'bot')
2018-11-26 10:00:32 [WARNING ] (13, 1, 'bot')
2018-11-26 10:00:32 [WARNING ] (13, 1, 'bot')
2018-11-26 10:00:32 [WARNING ] (13, 1, 'bot')
2018-11-26 10:00:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:00:32 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-26 10:00:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:00:48 [DEBUG   ] Got command RPT from MCS: ref #632205
2018-11-26 10:00:48 [DEBUG   ] summary = ERROR
2018-11-26 10:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632205  13 58448 36048669 A  ERRORERROR'
2018-11-26 10:00:48 [DEBUG   ] Got command RPT from MCS: ref #632206
2018-11-26 10:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632206  77 58448 36048670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:01:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 10:01:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 10:01:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:01:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:01:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:01:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:01:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:01:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:01:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:01:33 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-11-26 10:01:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 10:02:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 10:02:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 10:02:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:02:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:02:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:02:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:02:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:02:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:02:33 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-11-26 10:02:38 [DEBUG   ] Got command RPT from MCS: ref #632226
2018-11-26 10:02:38 [DEBUG   ] summary = ERROR
2018-11-26 10:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632226  13 58448 36158425 A  ERRORERROR'
2018-11-26 10:02:38 [DEBUG   ] Got command RPT from MCS: ref #632227
2018-11-26 10:02:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632227  77 58448 36158617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:02:38 [DEBUG   ] Got command RPT from MCS: ref #632228
2018-11-26 10:02:38 [DEBUG   ] summary = ERROR
2018-11-26 10:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632228  13 58448 36158821 A  ERRORERROR'
2018-11-26 10:02:39 [DEBUG   ] Got command RPT from MCS: ref #632230
2018-11-26 10:02:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632230  77 58448 36159025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:02:39 [DEBUG   ] Got command RPT from MCS: ref #632231
2018-11-26 10:02:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632231  12 58448 36159229 A  ERRORB˜™š'
2018-11-26 10:02:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 10:03:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:03:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:03:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:03:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 10:03:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:03:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:03:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:03:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:03:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:03:33 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-11-26 10:03:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:04:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:04:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:04:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:04:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:04:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:04:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:04:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:04:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:04:33 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-11-26 10:04:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:05:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:05:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:05:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:05:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:05:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:05:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:05:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:05:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:05:33 [DEBUG   ] Finished updating board flags in 1.900 seconds
2018-11-26 10:05:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:05:48 [DEBUG   ] Got command RPT from MCS: ref #632240
2018-11-26 10:05:48 [DEBUG   ] summary = ERROR
2018-11-26 10:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632240  13 58448 36348665 A  ERRORERROR'
2018-11-26 10:05:48 [DEBUG   ] Got command RPT from MCS: ref #632241
2018-11-26 10:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632241  77 58448 36348666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:06:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:06:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 10:06:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:06:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:06:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:06:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:06:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:06:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:06:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:06:33 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-11-26 10:06:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 10:07:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 10:07:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 10:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:07:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:07:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:07:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:07:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:07:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:07:33 [DEBUG   ] Finished updating board flags in 1.770 seconds
2018-11-26 10:07:38 [DEBUG   ] Got command RPT from MCS: ref #632261
2018-11-26 10:07:38 [DEBUG   ] summary = ERROR
2018-11-26 10:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632261  13 58448 36458501 A  ERRORERROR'
2018-11-26 10:07:38 [DEBUG   ] Got command RPT from MCS: ref #632262
2018-11-26 10:07:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632262  77 58448 36458705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:07:38 [DEBUG   ] Got command RPT from MCS: ref #632263
2018-11-26 10:07:38 [DEBUG   ] summary = ERROR
2018-11-26 10:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632263  13 58448 36458897 A  ERRORERROR'
2018-11-26 10:07:39 [DEBUG   ] Got command RPT from MCS: ref #632264
2018-11-26 10:07:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632264  77 58448 36459101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:07:39 [DEBUG   ] Got command RPT from MCS: ref #632265
2018-11-26 10:07:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632265  12 58448 36459305 A  ERRORB—™š'
2018-11-26 10:07:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 10:08:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:08:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:08:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:08:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:08:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:08:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:08:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:08:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:08:33 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-11-26 10:08:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:09:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:09:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:09:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:09:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:09:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:09:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:09:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:09:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:09:33 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-11-26 10:09:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:10:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:10:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:10:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:10:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:10:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:10:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:10:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:10:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:10:33 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-11-26 10:10:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 10:10:48 [DEBUG   ] Got command RPT from MCS: ref #632270
2018-11-26 10:10:48 [DEBUG   ] summary = ERROR
2018-11-26 10:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632270  13 58448 36648669 A  ERRORERROR'
2018-11-26 10:10:48 [DEBUG   ] Got command RPT from MCS: ref #632271
2018-11-26 10:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632271  77 58448 36648670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:11:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:11:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:11:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:11:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:11:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:11:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:11:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:11:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:11:33 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-11-26 10:11:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:12:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:12:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:12:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:12:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 10:12:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:12:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:12:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:12:33 [WARNING ] (13, 1, 'bot')
2018-11-26 10:12:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:12:33 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-11-26 10:12:38 [DEBUG   ] Got command RPT from MCS: ref #632289
2018-11-26 10:12:38 [DEBUG   ] summary = ERROR
2018-11-26 10:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632289  13 58448 36758581 A  ERRORERROR'
2018-11-26 10:12:38 [DEBUG   ] Got command RPT from MCS: ref #632290
2018-11-26 10:12:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632290  77 58448 36758785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:12:38 [DEBUG   ] Got command RPT from MCS: ref #632291
2018-11-26 10:12:38 [DEBUG   ] summary = ERROR
2018-11-26 10:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632291  13 58448 36758977 A  ERRORERROR'
2018-11-26 10:12:39 [DEBUG   ] Got command RPT from MCS: ref #632293
2018-11-26 10:12:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632293  77 58448 36759181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:12:39 [DEBUG   ] Got command RPT from MCS: ref #632294
2018-11-26 10:12:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632294  12 58448 36759385 A  ERRORB•™š'
2018-11-26 10:12:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:13:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:13:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:13:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:13:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:13:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:13:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:13:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:13:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:13:34 [DEBUG   ] Finished updating board flags in 2.310 seconds
2018-11-26 10:13:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:14:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:14:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:14:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:14:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 10:14:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:14:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:14:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:14:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:14:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:14:34 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-11-26 10:14:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 10:15:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:15:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:15:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:15:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:15:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:15:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:15:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:15:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:15:34 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-26 10:15:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:15:48 [DEBUG   ] Got command RPT from MCS: ref #632304
2018-11-26 10:15:48 [DEBUG   ] summary = ERROR
2018-11-26 10:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632304  13 58448 36948669 A  ERRORERROR'
2018-11-26 10:15:48 [DEBUG   ] Got command RPT from MCS: ref #632305
2018-11-26 10:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632305  77 58448 36948670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:16:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:16:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:16:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:16:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 10:16:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:16:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:16:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:16:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:16:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:16:34 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-26 10:16:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:17:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:17:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 10:17:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:17:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:17:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:17:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:17:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:17:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:17:34 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-11-26 10:17:38 [DEBUG   ] Got command RPT from MCS: ref #632324
2018-11-26 10:17:38 [DEBUG   ] summary = ERROR
2018-11-26 10:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632324  13 58448 37058665 A  ERRORERROR'
2018-11-26 10:17:38 [DEBUG   ] Got command RPT from MCS: ref #632325
2018-11-26 10:17:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632325  77 58448 37058857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:17:39 [DEBUG   ] Got command RPT from MCS: ref #632326
2018-11-26 10:17:39 [DEBUG   ] summary = ERROR
2018-11-26 10:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632326  13 58448 37059061 A  ERRORERROR'
2018-11-26 10:17:39 [DEBUG   ] Got command RPT from MCS: ref #632327
2018-11-26 10:17:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632327  77 58448 37059265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:17:39 [DEBUG   ] Got command RPT from MCS: ref #632328
2018-11-26 10:17:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632328  12 58448 37059469 A  ERRORB•™š'
2018-11-26 10:17:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:18:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:18:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 10:18:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 10:18:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:18:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-26 10:18:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:18:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:18:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:18:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:18:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:18:34 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-26 10:18:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:19:08 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-26 10:19:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 10:19:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:19:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:19:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:19:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:19:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:19:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:19:34 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-11-26 10:19:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 10:20:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:20:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:20:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:20:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 10:20:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:20:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:20:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:20:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:20:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:20:34 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-26 10:20:48 [DEBUG   ] Got command RPT from MCS: ref #632333
2018-11-26 10:20:48 [DEBUG   ] summary = ERROR
2018-11-26 10:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632333  13 58448 37248669 A  ERRORERROR'
2018-11-26 10:20:48 [DEBUG   ] Got command RPT from MCS: ref #632334
2018-11-26 10:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632334  77 58448 37248670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:20:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 10:21:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:21:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:21:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:21:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:21:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:21:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:21:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:21:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:21:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:21:34 [DEBUG   ] Finished updating board flags in 1.700 seconds
2018-11-26 10:21:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 10:22:09 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-26 10:22:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:22:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:22:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:22:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:22:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:22:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:22:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:22:34 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-11-26 10:22:38 [DEBUG   ] Got command RPT from MCS: ref #632356
2018-11-26 10:22:38 [DEBUG   ] summary = ERROR
2018-11-26 10:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632356  13 58448 37358737 A  ERRORERROR'
2018-11-26 10:22:38 [DEBUG   ] Got command RPT from MCS: ref #632357
2018-11-26 10:22:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632357  77 58448 37358941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:22:39 [DEBUG   ] Got command RPT from MCS: ref #632358
2018-11-26 10:22:39 [DEBUG   ] summary = ERROR
2018-11-26 10:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632358  13 58448 37359145 A  ERRORERROR'
2018-11-26 10:22:39 [DEBUG   ] Got command RPT from MCS: ref #632360
2018-11-26 10:22:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632360  77 58448 37359337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:22:39 [DEBUG   ] Got command RPT from MCS: ref #632362
2018-11-26 10:22:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632362  12 58448 37359541 A  ERRORB—™š'
2018-11-26 10:22:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:23:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:23:29 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-26 10:23:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:23:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:23:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:23:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:23:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:23:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:23:34 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-11-26 10:23:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:24:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 10:24:29 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 10:24:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:24:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:24:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:24:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:24:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:24:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:24:34 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-11-26 10:24:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 10:25:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 10:25:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:25:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:25:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:25:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:25:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:25:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:25:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:25:34 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-11-26 10:25:48 [DEBUG   ] Got command RPT from MCS: ref #632370
2018-11-26 10:25:48 [DEBUG   ] summary = ERROR
2018-11-26 10:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632370  13 58448 37548673 A  ERRORERROR'
2018-11-26 10:25:48 [DEBUG   ] Got command RPT from MCS: ref #632371
2018-11-26 10:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632371  77 58448 37548674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:25:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:26:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:26:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:26:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:26:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:26:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:26:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:26:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:26:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:26:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:26:34 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-11-26 10:26:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 10:27:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 10:27:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 10:27:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:27:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:27:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:27:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:27:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:27:34 [WARNING ] (13, 1, 'bot')
2018-11-26 10:27:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:27:34 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-11-26 10:27:38 [DEBUG   ] Got command RPT from MCS: ref #632387
2018-11-26 10:27:38 [DEBUG   ] summary = ERROR
2018-11-26 10:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632387  13 58448 37658825 A  ERRORERROR'
2018-11-26 10:27:39 [DEBUG   ] Got command RPT from MCS: ref #632388
2018-11-26 10:27:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632388  77 58448 37659017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:27:39 [DEBUG   ] Got command RPT from MCS: ref #632389
2018-11-26 10:27:39 [DEBUG   ] summary = ERROR
2018-11-26 10:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632389  13 58448 37659221 A  ERRORERROR'
2018-11-26 10:27:39 [DEBUG   ] Got command RPT from MCS: ref #632390
2018-11-26 10:27:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632390  77 58448 37659425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:27:39 [DEBUG   ] Got command RPT from MCS: ref #632391
2018-11-26 10:27:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632391  12 58448 37659629 A  ERRORB–™š'
2018-11-26 10:27:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 10:28:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 10:28:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:28:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:28:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:28:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:28:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:28:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:28:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:28:35 [DEBUG   ] Finished updating board flags in 2.197 seconds
2018-11-26 10:28:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:29:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:29:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 10:29:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:29:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:29:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:29:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:29:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:29:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:29:35 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-11-26 10:29:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 10:30:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:30:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 10:30:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:30:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:30:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:30:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:30:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:30:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:30:35 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-11-26 10:30:48 [DEBUG   ] Got command RPT from MCS: ref #632396
2018-11-26 10:30:48 [DEBUG   ] summary = ERROR
2018-11-26 10:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632396  13 58448 37848673 A  ERRORERROR'
2018-11-26 10:30:48 [DEBUG   ] Got command RPT from MCS: ref #632397
2018-11-26 10:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632397  77 58448 37848674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:30:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 10:31:11 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 10:31:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 10:31:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:31:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:31:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:31:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:31:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:31:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:31:35 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-11-26 10:31:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:32:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:32:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:32:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:32:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:32:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:32:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:32:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:32:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:32:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:32:35 [DEBUG   ] Finished updating board flags in 1.655 seconds
2018-11-26 10:32:38 [DEBUG   ] Got command RPT from MCS: ref #632419
2018-11-26 10:32:38 [DEBUG   ] summary = ERROR
2018-11-26 10:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632419  13 58448 37958897 A  ERRORERROR'
2018-11-26 10:32:39 [DEBUG   ] Got command RPT from MCS: ref #632420
2018-11-26 10:32:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632420  77 58448 37959101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:32:39 [DEBUG   ] Got command RPT from MCS: ref #632421
2018-11-26 10:32:39 [DEBUG   ] summary = ERROR
2018-11-26 10:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632421  13 58448 37959305 A  ERRORERROR'
2018-11-26 10:32:39 [DEBUG   ] Got command RPT from MCS: ref #632423
2018-11-26 10:32:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632423  77 58448 37959509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:32:39 [DEBUG   ] Got command RPT from MCS: ref #632424
2018-11-26 10:32:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632424  12 58448 37959701 A  ERRORB•™š'
2018-11-26 10:32:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 10:33:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 10:33:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 10:33:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:33:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:33:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:33:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:33:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:33:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:33:35 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-11-26 10:33:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 10:34:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 10:34:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 10:34:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:34:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:34:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:34:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:34:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:34:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:34:35 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-26 10:34:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:35:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:35:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:35:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:35:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:35:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:35:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:35:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:35:35 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-26 10:35:48 [DEBUG   ] Got command RPT from MCS: ref #632433
2018-11-26 10:35:48 [DEBUG   ] summary = ERROR
2018-11-26 10:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632433  13 58448 38148673 A  ERRORERROR'
2018-11-26 10:35:48 [DEBUG   ] Got command RPT from MCS: ref #632434
2018-11-26 10:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632434  77 58448 38148674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:35:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:36:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:36:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:36:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:36:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:36:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:36:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:36:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:36:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:36:35 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-26 10:36:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:37:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:37:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:37:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:37:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 10:37:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:37:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:37:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:37:35 [WARNING ] (13, 1, 'bot')
2018-11-26 10:37:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:37:35 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-11-26 10:37:38 [DEBUG   ] Got command RPT from MCS: ref #632454
2018-11-26 10:37:38 [DEBUG   ] summary = ERROR
2018-11-26 10:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632454  13 58448 38258989 A  ERRORERROR'
2018-11-26 10:37:39 [DEBUG   ] Got command RPT from MCS: ref #632455
2018-11-26 10:37:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632455  77 58448 38259181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:37:39 [DEBUG   ] Got command RPT from MCS: ref #632456
2018-11-26 10:37:39 [DEBUG   ] summary = ERROR
2018-11-26 10:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632456  13 58448 38259385 A  ERRORERROR'
2018-11-26 10:37:39 [DEBUG   ] Got command RPT from MCS: ref #632457
2018-11-26 10:37:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632457  77 58448 38259589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:37:39 [DEBUG   ] Got command RPT from MCS: ref #632458
2018-11-26 10:37:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632458  12 58448 38259781 A  ERRORB—™š'
2018-11-26 10:37:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:38:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:38:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 10:38:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:38:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:38:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:38:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:38:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:38:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:38:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:38:36 [DEBUG   ] Finished updating board flags in 2.220 seconds
2018-11-26 10:38:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:39:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:39:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 10:39:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:39:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:39:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:39:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:39:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:39:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:39:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:39:36 [DEBUG   ] Finished updating board flags in 2.102 seconds
2018-11-26 10:39:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:40:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:40:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 10:40:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:40:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:40:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:40:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:40:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:40:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:40:36 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-11-26 10:40:48 [DEBUG   ] Got command RPT from MCS: ref #632463
2018-11-26 10:40:48 [DEBUG   ] summary = ERROR
2018-11-26 10:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632463  13 58448 38448677 A  ERRORERROR'
2018-11-26 10:40:48 [DEBUG   ] Got command RPT from MCS: ref #632464
2018-11-26 10:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632464  77 58448 38448678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:40:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 10:41:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 10:41:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:41:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:41:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 10:41:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:41:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:41:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:41:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:41:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:41:36 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-26 10:41:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:42:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:42:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:42:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:42:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:42:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:42:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:42:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:42:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:42:36 [DEBUG   ] Finished updating board flags in 1.850 seconds
2018-11-26 10:42:39 [DEBUG   ] Got command RPT from MCS: ref #632482
2018-11-26 10:42:39 [DEBUG   ] summary = ERROR
2018-11-26 10:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632482  13 58448 38559065 A  ERRORERROR'
2018-11-26 10:42:39 [DEBUG   ] Got command RPT from MCS: ref #632483
2018-11-26 10:42:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632483  77 58448 38559257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:42:39 [DEBUG   ] Got command RPT from MCS: ref #632484
2018-11-26 10:42:39 [DEBUG   ] summary = ERROR
2018-11-26 10:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632484  13 58448 38559461 A  ERRORERROR'
2018-11-26 10:42:39 [DEBUG   ] Got command RPT from MCS: ref #632486
2018-11-26 10:42:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632486  77 58448 38559665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:42:39 [DEBUG   ] Got command RPT from MCS: ref #632487
2018-11-26 10:42:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632487  12 58448 38559869 A  ERRORB–™š'
2018-11-26 10:42:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:43:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:43:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 10:43:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:43:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:43:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:43:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:43:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:43:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:43:36 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-26 10:43:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:44:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:44:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:44:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:44:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:44:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:44:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:44:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:44:36 [DEBUG   ] Finished updating board flags in 1.741 seconds
2018-11-26 10:44:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 10:45:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 10:45:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:45:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:45:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:45:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:45:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:45:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:45:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:45:36 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-26 10:45:48 [DEBUG   ] Got command RPT from MCS: ref #632496
2018-11-26 10:45:48 [DEBUG   ] summary = ERROR
2018-11-26 10:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632496  13 58448 38748669 A  ERRORERROR'
2018-11-26 10:45:48 [DEBUG   ] Got command RPT from MCS: ref #632497
2018-11-26 10:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632497  77 58448 38748670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:45:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:46:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 10:46:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:46:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:46:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:46:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:46:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:46:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:46:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:46:36 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-26 10:46:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:47:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:47:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:47:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:47:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:47:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:47:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:47:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:47:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:47:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:47:36 [DEBUG   ] Finished updating board flags in 1.524 seconds
2018-11-26 10:47:39 [DEBUG   ] Got command RPT from MCS: ref #632517
2018-11-26 10:47:39 [DEBUG   ] summary = ERROR
2018-11-26 10:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632517  13 58448 38859141 A  ERRORERROR'
2018-11-26 10:47:39 [DEBUG   ] Got command RPT from MCS: ref #632518
2018-11-26 10:47:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632518  77 58448 38859345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:47:39 [DEBUG   ] Got command RPT from MCS: ref #632519
2018-11-26 10:47:39 [DEBUG   ] summary = ERROR
2018-11-26 10:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632519  13 58448 38859537 A  ERRORERROR'
2018-11-26 10:47:39 [DEBUG   ] Got command RPT from MCS: ref #632520
2018-11-26 10:47:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632520  77 58448 38859741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:47:39 [DEBUG   ] Got command RPT from MCS: ref #632521
2018-11-26 10:47:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632521  12 58448 38859945 A  ERRORB–™š'
2018-11-26 10:47:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:48:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:48:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 10:48:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:48:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:48:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:48:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:48:36 [WARNING ] (13, 1, 'bot')
2018-11-26 10:48:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:48:36 [DEBUG   ] Finished updating board flags in 1.555 seconds
2018-11-26 10:48:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:49:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:49:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:49:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:49:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-26 10:49:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:49:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 10:49:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:49:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:49:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:49:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:49:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:49:37 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-11-26 10:49:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 10:50:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 10:50:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 10:50:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:50:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 10:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:50:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:50:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:50:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:50:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:50:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:50:37 [DEBUG   ] Finished updating board flags in 2.107 seconds
2018-11-26 10:50:48 [DEBUG   ] Got command RPT from MCS: ref #632526
2018-11-26 10:50:48 [DEBUG   ] summary = ERROR
2018-11-26 10:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632526  13 58448 39048677 A  ERRORERROR'
2018-11-26 10:50:48 [DEBUG   ] Got command RPT from MCS: ref #632527
2018-11-26 10:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632527  77 58448 39048678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:50:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 10:51:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-26 10:51:33 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-26 10:51:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:51:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:51:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:51:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:51:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:51:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:51:37 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-11-26 10:51:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 10:52:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:52:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 10:52:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 10:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:52:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:52:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:52:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:52:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:52:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:52:37 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-11-26 10:52:39 [DEBUG   ] Got command RPT from MCS: ref #632549
2018-11-26 10:52:39 [DEBUG   ] summary = ERROR
2018-11-26 10:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632549  13 58448 39159225 A  ERRORERROR'
2018-11-26 10:52:39 [DEBUG   ] Got command RPT from MCS: ref #632550
2018-11-26 10:52:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632550  77 58448 39159417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:52:39 [DEBUG   ] Got command RPT from MCS: ref #632551
2018-11-26 10:52:39 [DEBUG   ] summary = ERROR
2018-11-26 10:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632551  13 58448 39159621 A  ERRORERROR'
2018-11-26 10:52:39 [DEBUG   ] Got command RPT from MCS: ref #632553
2018-11-26 10:52:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632553  77 58448 39159825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:52:40 [DEBUG   ] Got command RPT from MCS: ref #632554
2018-11-26 10:52:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632554  12 58448 39160029 A  ERRORB˜™š'
2018-11-26 10:52:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 10:53:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:53:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 10:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:53:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:53:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:53:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:53:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:53:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:53:37 [DEBUG   ] Finished updating board flags in 1.844 seconds
2018-11-26 10:53:53 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 10:54:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 10:54:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 10:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:54:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:54:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:54:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:54:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:54:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:54:37 [DEBUG   ] Finished updating board flags in 1.748 seconds
2018-11-26 10:54:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 10:55:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 10:55:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:55:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:55:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:55:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:55:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:55:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:55:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:55:37 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-11-26 10:55:48 [DEBUG   ] Got command RPT from MCS: ref #632563
2018-11-26 10:55:48 [DEBUG   ] summary = ERROR
2018-11-26 10:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632563  13 58448 39348677 A  ERRORERROR'
2018-11-26 10:55:48 [DEBUG   ] Got command RPT from MCS: ref #632564
2018-11-26 10:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632564  77 58448 39348678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:55:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:56:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:56:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 10:56:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:56:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:56:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:56:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:56:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:56:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:56:37 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-11-26 10:56:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 10:57:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:57:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 10:57:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:57:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:57:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:57:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:57:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:57:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:57:37 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-26 10:57:39 [DEBUG   ] Got command RPT from MCS: ref #632580
2018-11-26 10:57:39 [DEBUG   ] summary = ERROR
2018-11-26 10:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632580  13 58448 39459305 A  ERRORERROR'
2018-11-26 10:57:39 [DEBUG   ] Got command RPT from MCS: ref #632581
2018-11-26 10:57:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632581  77 58448 39459497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:57:39 [DEBUG   ] Got command RPT from MCS: ref #632582
2018-11-26 10:57:39 [DEBUG   ] summary = ERROR
2018-11-26 10:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632582  13 58448 39459701 A  ERRORERROR'
2018-11-26 10:57:39 [DEBUG   ] Got command RPT from MCS: ref #632583
2018-11-26 10:57:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 10:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632583  77 58448 39459905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 10:57:40 [DEBUG   ] Got command RPT from MCS: ref #632584
2018-11-26 10:57:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 10:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632584  12 58448 39460109 A  ERRORB—™š'
2018-11-26 10:57:53 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-26 10:58:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:58:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 10:58:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:58:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:58:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:58:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:58:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:58:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:58:37 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-11-26 10:58:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 10:59:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:59:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 10:59:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 10:59:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:59:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:59:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:59:37 [WARNING ] (13, 1, 'bot')
2018-11-26 10:59:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 10:59:37 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-11-26 10:59:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 11:00:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 11:00:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-26 11:00:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:00:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:00:37 [WARNING ] (13, 1, 'bot')
2018-11-26 11:00:37 [WARNING ] (13, 1, 'bot')
2018-11-26 11:00:37 [WARNING ] (13, 1, 'bot')
2018-11-26 11:00:37 [WARNING ] (13, 1, 'bot')
2018-11-26 11:00:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:00:37 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-11-26 11:00:48 [DEBUG   ] Got command RPT from MCS: ref #632589
2018-11-26 11:00:48 [DEBUG   ] summary = ERROR
2018-11-26 11:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632589  13 58448 39648681 A  ERRORERROR'
2018-11-26 11:00:48 [DEBUG   ] Got command RPT from MCS: ref #632590
2018-11-26 11:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632590  77 58448 39648682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:00:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 11:01:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 11:01:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 11:01:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:01:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:01:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:01:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:01:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:01:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:01:38 [DEBUG   ] Finished updating board flags in 2.187 seconds
2018-11-26 11:01:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 11:02:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 11:02:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 11:02:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:02:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:02:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:02:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:02:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:02:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:02:38 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-11-26 11:02:39 [DEBUG   ] Got command RPT from MCS: ref #632612
2018-11-26 11:02:39 [DEBUG   ] summary = ERROR
2018-11-26 11:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632612  13 58448 39759381 A  ERRORERROR'
2018-11-26 11:02:39 [DEBUG   ] Got command RPT from MCS: ref #632613
2018-11-26 11:02:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632613  77 58448 39759585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:02:39 [DEBUG   ] Got command RPT from MCS: ref #632614
2018-11-26 11:02:39 [DEBUG   ] summary = ERROR
2018-11-26 11:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632614  13 58448 39759789 A  ERRORERROR'
2018-11-26 11:02:39 [DEBUG   ] Got command RPT from MCS: ref #632616
2018-11-26 11:02:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632616  77 58448 39759981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:02:40 [DEBUG   ] Got command RPT from MCS: ref #632618
2018-11-26 11:02:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632618  12 58448 39760185 A  ERRORB–™š'
2018-11-26 11:02:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 11:03:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 11:03:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 11:03:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:03:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:03:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:03:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:03:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:03:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:03:38 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-11-26 11:03:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 11:04:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:04:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:04:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-11-26 11:04:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:04:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:04:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:04:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:04:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:04:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:04:38 [DEBUG   ] Finished updating board flags in 1.734 seconds
2018-11-26 11:04:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 11:05:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 11:05:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 11:05:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:05:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:05:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:05:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:05:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:05:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:05:38 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-26 11:05:48 [DEBUG   ] Got command RPT from MCS: ref #632626
2018-11-26 11:05:48 [DEBUG   ] summary = ERROR
2018-11-26 11:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632626  13 58448 39948673 A  ERRORERROR'
2018-11-26 11:05:48 [DEBUG   ] Got command RPT from MCS: ref #632627
2018-11-26 11:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632627  77 58448 39948674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:05:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-26 11:06:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 11:06:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 11:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:06:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:06:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:06:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:06:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:06:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:06:38 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-26 11:06:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 11:07:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 11:07:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 11:07:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:07:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:07:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:07:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:07:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:07:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:07:38 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-26 11:07:39 [DEBUG   ] Got command RPT from MCS: ref #632647
2018-11-26 11:07:39 [DEBUG   ] summary = ERROR
2018-11-26 11:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632647  13 58448 40059469 A  ERRORERROR'
2018-11-26 11:07:39 [DEBUG   ] Got command RPT from MCS: ref #632648
2018-11-26 11:07:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632648  77 58448 40059661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:07:39 [DEBUG   ] Got command RPT from MCS: ref #632649
2018-11-26 11:07:39 [DEBUG   ] summary = ERROR
2018-11-26 11:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632649  13 58448 40059865 A  ERRORERROR'
2018-11-26 11:07:40 [DEBUG   ] Got command RPT from MCS: ref #632650
2018-11-26 11:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632650  77 58448 40060069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:07:40 [DEBUG   ] Got command RPT from MCS: ref #632651
2018-11-26 11:07:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632651  12 58448 40060273 A  ERRORB–™š'
2018-11-26 11:07:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 11:08:15 [DEBUG   ] Finished updating ant stats in 0.779 seconds
2018-11-26 11:08:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 11:08:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:08:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:08:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:08:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:08:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:08:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:08:38 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-11-26 11:08:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 11:09:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 11:09:36 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-26 11:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:09:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:09:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:09:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:09:38 [WARNING ] (13, 1, 'bot')
2018-11-26 11:09:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:09:38 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-26 11:09:56 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-26 11:10:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 11:10:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:10:38 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:10:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:10:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 11:10:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:10:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:10:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:10:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:10:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:10:39 [DEBUG   ] Finished updating board flags in 2.097 seconds
2018-11-26 11:10:48 [DEBUG   ] Got command RPT from MCS: ref #632656
2018-11-26 11:10:48 [DEBUG   ] summary = ERROR
2018-11-26 11:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632656  13 58448 40248685 A  ERRORERROR'
2018-11-26 11:10:48 [DEBUG   ] Got command RPT from MCS: ref #632657
2018-11-26 11:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632657  77 58448 40248686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:10:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 11:11:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 11:11:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 11:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:11:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:11:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:11:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:11:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:11:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:11:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:11:39 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-26 11:11:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 11:12:16 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2018-11-26 11:12:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 11:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:12:39 [DEBUG   ] Got command RPT from MCS: ref #632675
2018-11-26 11:12:39 [DEBUG   ] summary = ERROR
2018-11-26 11:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632675  13 58448 40359538 A  ERRORERROR'
2018-11-26 11:12:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:12:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:12:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:12:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:12:39 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-11-26 11:12:39 [DEBUG   ] Got command RPT from MCS: ref #632676
2018-11-26 11:12:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632676  77 58448 40359741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:12:39 [DEBUG   ] Got command RPT from MCS: ref #632677
2018-11-26 11:12:39 [DEBUG   ] summary = ERROR
2018-11-26 11:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632677  13 58448 40359945 A  ERRORERROR'
2018-11-26 11:12:40 [DEBUG   ] Got command RPT from MCS: ref #632679
2018-11-26 11:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632679  77 58448 40360149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:12:40 [DEBUG   ] Got command RPT from MCS: ref #632681
2018-11-26 11:12:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632681  12 58448 40360341 A  ERRORB˜™š'
2018-11-26 11:12:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:13:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 11:13:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 11:13:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:13:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:13:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:13:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:13:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:13:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:13:39 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-26 11:13:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 11:14:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 11:14:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 11:14:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:14:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:14:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:14:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:14:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:14:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:14:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:14:39 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-11-26 11:14:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:15:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:15:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 11:15:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:15:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:15:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:15:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:15:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:15:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:15:39 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-26 11:15:48 [DEBUG   ] Got command RPT from MCS: ref #632689
2018-11-26 11:15:48 [DEBUG   ] summary = ERROR
2018-11-26 11:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632689  13 58448 40548677 A  ERRORERROR'
2018-11-26 11:15:48 [DEBUG   ] Got command RPT from MCS: ref #632690
2018-11-26 11:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632690  77 58448 40548678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:15:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 11:16:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 11:16:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 11:16:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:16:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:16:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:16:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:16:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:16:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:16:39 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-11-26 11:16:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-26 11:17:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 11:17:37 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-26 11:17:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:17:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:17:39 [DEBUG   ] Got command RPT from MCS: ref #632710
2018-11-26 11:17:39 [DEBUG   ] summary = ERROR
2018-11-26 11:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632710  13 58448 40659841 A  ERRORERROR'
2018-11-26 11:17:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:17:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:17:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:17:39 [WARNING ] (13, 1, 'bot')
2018-11-26 11:17:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:17:39 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-26 11:17:40 [DEBUG   ] Got command RPT from MCS: ref #632711
2018-11-26 11:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632711  77 58448 40660022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:17:40 [DEBUG   ] Got command RPT from MCS: ref #632712
2018-11-26 11:17:40 [DEBUG   ] summary = ERROR
2018-11-26 11:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632712  13 58448 40660225 A  ERRORERROR'
2018-11-26 11:17:40 [DEBUG   ] Got command RPT from MCS: ref #632713
2018-11-26 11:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632713  77 58448 40660429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:17:40 [DEBUG   ] Got command RPT from MCS: ref #632714
2018-11-26 11:17:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632714  12 58448 40660633 A  ERRORB—™š'
2018-11-26 11:17:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:18:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 11:18:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 11:18:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:18:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:18:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:18:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:18:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:18:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:18:40 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-11-26 11:18:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 11:19:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:19:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 11:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:19:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:19:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:19:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:19:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:19:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:19:40 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-11-26 11:19:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 11:20:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-26 11:20:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-26 11:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:20:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:20:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:20:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:20:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:20:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:20:40 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-11-26 11:20:48 [DEBUG   ] Got command RPT from MCS: ref #632719
2018-11-26 11:20:48 [DEBUG   ] summary = ERROR
2018-11-26 11:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632719  13 58448 40848677 A  ERRORERROR'
2018-11-26 11:20:48 [DEBUG   ] Got command RPT from MCS: ref #632720
2018-11-26 11:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632720  77 58448 40848678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:20:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-26 11:21:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 11:21:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 11:21:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:21:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:21:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:21:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:21:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:21:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:21:40 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-11-26 11:21:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 11:22:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 11:22:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 11:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:22:39 [DEBUG   ] Got command RPT from MCS: ref #632742
2018-11-26 11:22:39 [DEBUG   ] summary = ERROR
2018-11-26 11:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632742  13 58448 40959709 A  ERRORERROR'
2018-11-26 11:22:39 [DEBUG   ] Got command RPT from MCS: ref #632743
2018-11-26 11:22:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632743  77 58448 40959901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:22:40 [DEBUG   ] Got command RPT from MCS: ref #632744
2018-11-26 11:22:40 [DEBUG   ] summary = ERROR
2018-11-26 11:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632744  13 58448 40960105 A  ERRORERROR'
2018-11-26 11:22:40 [DEBUG   ] Got command RPT from MCS: ref #632746
2018-11-26 11:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632746  77 58448 40960301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:22:40 [DEBUG   ] Got command RPT from MCS: ref #632748
2018-11-26 11:22:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632748  12 58448 40960505 A  ERRORB–™š'
2018-11-26 11:22:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:22:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:22:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:22:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:22:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:22:40 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-26 11:22:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 11:23:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 11:23:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 11:23:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:23:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:23:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:23:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:23:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:23:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:23:40 [DEBUG   ] Finished updating board flags in 1.847 seconds
2018-11-26 11:23:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 11:24:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 11:24:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 11:24:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:24:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:24:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:24:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:24:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:24:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:24:40 [DEBUG   ] Finished updating board flags in 1.745 seconds
2018-11-26 11:24:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 11:25:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 11:25:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:25:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:25:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:25:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:25:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:25:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:25:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:25:40 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-11-26 11:25:48 [DEBUG   ] Got command RPT from MCS: ref #632756
2018-11-26 11:25:48 [DEBUG   ] summary = ERROR
2018-11-26 11:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632756  13 58448 41148685 A  ERRORERROR'
2018-11-26 11:25:48 [DEBUG   ] Got command RPT from MCS: ref #632757
2018-11-26 11:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632757  77 58448 41148686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:25:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 11:26:18 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-26 11:26:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:26:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 11:26:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:26:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:26:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:26:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:26:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:26:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:26:40 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-26 11:26:59 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 11:27:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 11:27:39 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:27:39 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2018-11-26 11:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:27:39 [DEBUG   ] Got command RPT from MCS: ref #632773
2018-11-26 11:27:39 [DEBUG   ] summary = ERROR
2018-11-26 11:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632773  13 58448 41259790 A  ERRORERROR'
2018-11-26 11:27:39 [DEBUG   ] Got command RPT from MCS: ref #632774
2018-11-26 11:27:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632774  77 58448 41259981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:27:40 [DEBUG   ] Got command RPT from MCS: ref #632775
2018-11-26 11:27:40 [DEBUG   ] summary = ERROR
2018-11-26 11:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632775  13 58448 41260186 A  ERRORERROR'
2018-11-26 11:27:40 [DEBUG   ] Got command RPT from MCS: ref #632776
2018-11-26 11:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632776  77 58448 41260389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:27:40 [DEBUG   ] Got command RPT from MCS: ref #632777
2018-11-26 11:27:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632777  12 58448 41260593 A  ERRORB–™š'
2018-11-26 11:27:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:27:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:27:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:27:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:27:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:27:40 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-11-26 11:27:59 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2018-11-26 11:28:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 11:28:39 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2018-11-26 11:28:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:28:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:28:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:28:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:28:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:28:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:28:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:28:40 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-26 11:28:59 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-11-26 11:29:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 11:29:39 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-11-26 11:29:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:29:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-26 11:29:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:29:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:29:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:29:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:29:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:29:40 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-26 11:29:59 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-11-26 11:30:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 11:30:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 11:30:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:30:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:30:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:30:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:30:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:30:40 [WARNING ] (13, 1, 'bot')
2018-11-26 11:30:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:30:40 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-11-26 11:30:48 [DEBUG   ] Got command RPT from MCS: ref #632782
2018-11-26 11:30:48 [DEBUG   ] summary = ERROR
2018-11-26 11:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632782  13 58448 41448689 A  ERRORERROR'
2018-11-26 11:30:48 [DEBUG   ] Got command RPT from MCS: ref #632783
2018-11-26 11:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632783  77 58448 41448690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:30:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 11:31:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:31:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 11:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:31:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:31:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:31:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:31:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:31:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:31:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:31:41 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-11-26 11:31:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:32:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-26 11:32:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:32:39 [DEBUG   ] Got command RPT from MCS: ref #632805
2018-11-26 11:32:39 [DEBUG   ] summary = ERROR
2018-11-26 11:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632805  13 58448 41559865 A  ERRORERROR'
2018-11-26 11:32:40 [DEBUG   ] Got command RPT from MCS: ref #632806
2018-11-26 11:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632806  77 58448 41560070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:32:40 [DEBUG   ] Got command RPT from MCS: ref #632807
2018-11-26 11:32:40 [DEBUG   ] summary = ERROR
2018-11-26 11:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632807  13 58448 41560261 A  ERRORERROR'
2018-11-26 11:32:40 [DEBUG   ] Got command RPT from MCS: ref #632809
2018-11-26 11:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632809  77 58448 41560466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:32:40 [DEBUG   ] Got command RPT from MCS: ref #632810
2018-11-26 11:32:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632810  12 58448 41560670 A  ERRORBŽÌÍ'
2018-11-26 11:32:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:32:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:32:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:32:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:32:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:32:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:32:41 [DEBUG   ] Finished updating board flags in 1.922 seconds
2018-11-26 11:32:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:33:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:33:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 11:33:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:33:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:33:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:33:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:33:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:33:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:33:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:33:41 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-11-26 11:33:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:34:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:34:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 11:34:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 11:34:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:34:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:34:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:34:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:34:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:34:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:34:41 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-11-26 11:34:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-26 11:35:20 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 11:35:40 [DEBUG   ] Finished updating ant stats in 1.260 seconds
2018-11-26 11:35:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:35:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:35:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:35:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:35:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:35:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:35:41 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-11-26 11:35:48 [DEBUG   ] Got command RPT from MCS: ref #632819
2018-11-26 11:35:48 [DEBUG   ] summary = ERROR
2018-11-26 11:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632819  13 58448 41748681 A  ERRORERROR'
2018-11-26 11:35:48 [DEBUG   ] Got command RPT from MCS: ref #632820
2018-11-26 11:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632820  77 58448 41748682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:36:00 [DEBUG   ] Finished updating ant stats in 1.148 seconds
2018-11-26 11:36:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 11:36:40 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-11-26 11:36:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:36:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:36:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:36:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:36:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:36:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:36:41 [DEBUG   ] Finished updating board flags in 1.743 seconds
2018-11-26 11:37:00 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-11-26 11:37:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 11:37:39 [DEBUG   ] Got command RPT from MCS: ref #632840
2018-11-26 11:37:39 [DEBUG   ] summary = ERROR
2018-11-26 11:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632840  13 58448 41859949 A  ERRORERROR'
2018-11-26 11:37:40 [DEBUG   ] Got command RPT from MCS: ref #632841
2018-11-26 11:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632841  77 58448 41860141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:37:40 [DEBUG   ] Got command RPT from MCS: ref #632842
2018-11-26 11:37:40 [DEBUG   ] summary = ERROR
2018-11-26 11:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632842  13 58448 41860345 A  ERRORERROR'
2018-11-26 11:37:40 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-11-26 11:37:40 [DEBUG   ] Got command RPT from MCS: ref #632843
2018-11-26 11:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632843  77 58448 41860550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:37:40 [DEBUG   ] Got command RPT from MCS: ref #632844
2018-11-26 11:37:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632844  12 58448 41860746 A  ERRORB�ÌÍ'
2018-11-26 11:37:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:37:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:37:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:37:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:37:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:37:41 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-11-26 11:38:00 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-11-26 11:38:21 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2018-11-26 11:38:40 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2018-11-26 11:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:38:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:38:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:38:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:38:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:38:41 [DEBUG   ] Finished updating board flags in 1.536 seconds
2018-11-26 11:39:00 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-11-26 11:39:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 11:39:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:39:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:39:41 [DEBUG   ] Finished updating ant stats in 1.447 seconds
2018-11-26 11:39:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:39:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:39:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:39:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:39:41 [DEBUG   ] Finished updating board flags in 1.473 seconds
2018-11-26 11:40:01 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2018-11-26 11:40:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:40:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:40:41 [DEBUG   ] Finished updating ant stats in 1.255 seconds
2018-11-26 11:40:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:40:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:40:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:40:41 [WARNING ] (13, 1, 'bot')
2018-11-26 11:40:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:40:41 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-11-26 11:40:48 [DEBUG   ] Got command RPT from MCS: ref #632849
2018-11-26 11:40:48 [DEBUG   ] summary = ERROR
2018-11-26 11:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632849  13 58448 42048681 A  ERRORERROR'
2018-11-26 11:40:48 [DEBUG   ] Got command RPT from MCS: ref #632850
2018-11-26 11:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632850  77 58448 42048682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:41:01 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-11-26 11:41:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 11:41:41 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2018-11-26 11:41:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:41:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:41:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:41:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:41:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:41:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:41:42 [DEBUG   ] Finished updating board flags in 2.266 seconds
2018-11-26 11:42:01 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-11-26 11:42:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-26 11:42:40 [DEBUG   ] Got command RPT from MCS: ref #632868
2018-11-26 11:42:40 [DEBUG   ] summary = ERROR
2018-11-26 11:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632868  13 58448 42160021 A  ERRORERROR'
2018-11-26 11:42:40 [DEBUG   ] Got command RPT from MCS: ref #632869
2018-11-26 11:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632869  77 58448 42160225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:42:40 [DEBUG   ] Got command RPT from MCS: ref #632870
2018-11-26 11:42:40 [DEBUG   ] summary = ERROR
2018-11-26 11:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632870  13 58448 42160429 A  ERRORERROR'
2018-11-26 11:42:40 [DEBUG   ] Got command RPT from MCS: ref #632872
2018-11-26 11:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632872  77 58448 42160621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:42:40 [DEBUG   ] Got command RPT from MCS: ref #632873
2018-11-26 11:42:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632873  12 58448 42160825 A  ERRORB–™š'
2018-11-26 11:42:41 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2018-11-26 11:42:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:42:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:42:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:42:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:42:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:42:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:42:42 [DEBUG   ] Finished updating board flags in 2.107 seconds
2018-11-26 11:43:02 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-11-26 11:43:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:43:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:43:42 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2018-11-26 11:43:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:43:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:43:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:43:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:43:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:43:42 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-11-26 11:44:02 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-11-26 11:44:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 11:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:44:42 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-11-26 11:44:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 11:44:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:44:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:44:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:44:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:44:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:44:42 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-11-26 11:45:02 [DEBUG   ] Finished updating ant stats in 0.962 seconds
2018-11-26 11:45:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 11:45:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:45:42 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-11-26 11:45:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:45:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:45:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:45:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:45:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:45:42 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-11-26 11:45:48 [DEBUG   ] Got command RPT from MCS: ref #632882
2018-11-26 11:45:48 [DEBUG   ] summary = ERROR
2018-11-26 11:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632882  13 58448 42348689 A  ERRORERROR'
2018-11-26 11:45:48 [DEBUG   ] Got command RPT from MCS: ref #632883
2018-11-26 11:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632883  77 58448 42348690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:46:02 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-11-26 11:46:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 11:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:46:42 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-11-26 11:46:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:46:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:46:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:46:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:46:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:46:42 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-11-26 11:47:02 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-11-26 11:47:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 11:47:40 [DEBUG   ] Got command RPT from MCS: ref #632903
2018-11-26 11:47:40 [DEBUG   ] summary = ERROR
2018-11-26 11:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632903  13 58448 42460109 A  ERRORERROR'
2018-11-26 11:47:40 [DEBUG   ] Got command RPT from MCS: ref #632904
2018-11-26 11:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632904  77 58448 42460301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:47:40 [DEBUG   ] Got command RPT from MCS: ref #632905
2018-11-26 11:47:40 [DEBUG   ] summary = ERROR
2018-11-26 11:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632905  13 58448 42460505 A  ERRORERROR'
2018-11-26 11:47:40 [DEBUG   ] Got command RPT from MCS: ref #632906
2018-11-26 11:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632906  77 58448 42460709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:47:40 [DEBUG   ] Got command RPT from MCS: ref #632907
2018-11-26 11:47:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632907  12 58448 42460913 A  ERRORB–™š'
2018-11-26 11:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:47:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:47:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:47:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:47:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:47:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:47:42 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-26 11:47:43 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-11-26 11:48:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 11:48:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:48:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:48:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:48:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:48:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:48:42 [DEBUG   ] Finished updating board flags in 1.554 seconds
2018-11-26 11:48:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:49:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:49:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 11:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:49:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:49:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:49:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:49:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:49:42 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-11-26 11:49:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:50:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:50:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 11:50:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:50:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:50:43 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-26 11:50:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:50:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:50:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:50:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:50:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:50:43 [DEBUG   ] Finished updating board flags in 2.306 seconds
2018-11-26 11:50:48 [DEBUG   ] Got command RPT from MCS: ref #632912
2018-11-26 11:50:48 [DEBUG   ] summary = ERROR
2018-11-26 11:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632912  13 58448 42648681 A  ERRORERROR'
2018-11-26 11:50:48 [DEBUG   ] Got command RPT from MCS: ref #632913
2018-11-26 11:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632913  77 58448 42648682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:51:03 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-26 11:51:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 11:51:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:51:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:51:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:51:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:51:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:51:42 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-11-26 11:51:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 11:52:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 11:52:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 11:52:40 [DEBUG   ] Got command RPT from MCS: ref #632935
2018-11-26 11:52:40 [DEBUG   ] summary = ERROR
2018-11-26 11:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632935  13 58448 42760189 A  ERRORERROR'
2018-11-26 11:52:40 [DEBUG   ] Got command RPT from MCS: ref #632936
2018-11-26 11:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632936  77 58448 42760381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:52:40 [DEBUG   ] Got command RPT from MCS: ref #632937
2018-11-26 11:52:40 [DEBUG   ] summary = ERROR
2018-11-26 11:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632937  13 58448 42760585 A  ERRORERROR'
2018-11-26 11:52:40 [DEBUG   ] Got command RPT from MCS: ref #632939
2018-11-26 11:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632939  77 58448 42760789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:52:40 [DEBUG   ] Got command RPT from MCS: ref #632940
2018-11-26 11:52:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632940  12 58448 42760993 A  ERRORB–™š'
2018-11-26 11:52:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:52:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:52:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:52:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:52:42 [WARNING ] (13, 1, 'bot')
2018-11-26 11:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:52:42 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-11-26 11:52:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 11:53:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 11:53:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 11:53:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:53:43 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-11-26 11:53:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:53:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:53:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:53:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:53:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:53:43 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-11-26 11:54:03 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-11-26 11:54:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 11:54:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:54:43 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-11-26 11:54:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:54:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:54:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:54:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:54:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:54:43 [DEBUG   ] Finished updating board flags in 2.126 seconds
2018-11-26 11:55:03 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-11-26 11:55:23 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-26 11:55:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:55:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 11:55:43 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2018-11-26 11:55:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:55:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:55:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:55:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:55:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:55:43 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-11-26 11:55:48 [DEBUG   ] Got command RPT from MCS: ref #632949
2018-11-26 11:55:48 [DEBUG   ] summary = ERROR
2018-11-26 11:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632949  13 58448 42948685 A  ERRORERROR'
2018-11-26 11:55:48 [DEBUG   ] Got command RPT from MCS: ref #632950
2018-11-26 11:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632950  77 58448 42948686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:56:04 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2018-11-26 11:56:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:56:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:56:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:56:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:56:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:56:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:56:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:56:43 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-11-26 11:56:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 11:57:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 11:57:24 [DEBUG   ] Finished updating ant stats in 1.127 seconds
2018-11-26 11:57:40 [DEBUG   ] Got command RPT from MCS: ref #632966
2018-11-26 11:57:40 [DEBUG   ] summary = ERROR
2018-11-26 11:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632966  13 58448 43060261 A  ERRORERROR'
2018-11-26 11:57:40 [DEBUG   ] Got command RPT from MCS: ref #632967
2018-11-26 11:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632967  77 58448 43060465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:57:40 [DEBUG   ] Got command RPT from MCS: ref #632968
2018-11-26 11:57:40 [DEBUG   ] summary = ERROR
2018-11-26 11:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632968  13 58448 43060669 A  ERRORERROR'
2018-11-26 11:57:40 [DEBUG   ] Got command RPT from MCS: ref #632969
2018-11-26 11:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 11:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632969  77 58448 43060861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 11:57:41 [DEBUG   ] Got command RPT from MCS: ref #632970
2018-11-26 11:57:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 11:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632970  12 58448 43061065 A  ERRORB—™š'
2018-11-26 11:57:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 11:57:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:57:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:57:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:57:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:57:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:57:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:57:43 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-11-26 11:57:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 11:58:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 11:58:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 11:58:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:58:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:58:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:58:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:58:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:58:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:58:43 [DEBUG   ] Finished updating board flags in 1.744 seconds
2018-11-26 11:58:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 11:59:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 11:59:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 11:59:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 11:59:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:59:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:59:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:59:43 [WARNING ] (13, 1, 'bot')
2018-11-26 11:59:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 11:59:43 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-26 11:59:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 12:00:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 12:00:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 12:00:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:00:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:00:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:00:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:00:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:00:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:00:43 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-11-26 12:00:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 12:00:48 [DEBUG   ] Got command RPT from MCS: ref #632975
2018-11-26 12:00:48 [DEBUG   ] summary = ERROR
2018-11-26 12:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632975  13 58448 43248685 A  ERRORERROR'
2018-11-26 12:00:48 [DEBUG   ] Got command RPT from MCS: ref #632976
2018-11-26 12:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632976  77 58448 43248686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:01:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 12:01:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 12:01:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:01:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:01:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:01:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:01:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:01:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:01:43 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-11-26 12:01:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 12:02:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 12:02:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 12:02:40 [DEBUG   ] Got command RPT from MCS: ref #632998
2018-11-26 12:02:40 [DEBUG   ] summary = ERROR
2018-11-26 12:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632998  13 58448 43360349 A  ERRORERROR'
2018-11-26 12:02:40 [DEBUG   ] Got command RPT from MCS: ref #632999
2018-11-26 12:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   632999  77 58448 43360541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:02:40 [DEBUG   ] Got command RPT from MCS: ref #633000
2018-11-26 12:02:40 [DEBUG   ] summary = ERROR
2018-11-26 12:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633000  13 58448 43360745 A  ERRORERROR'
2018-11-26 12:02:40 [DEBUG   ] Got command RPT from MCS: ref #633002
2018-11-26 12:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633002  77 58448 43360949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:02:41 [DEBUG   ] Got command RPT from MCS: ref #633003
2018-11-26 12:02:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633003  12 58448 43361141 A  ERRORB–™š'
2018-11-26 12:02:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:02:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:02:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:02:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:02:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:02:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:02:43 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-11-26 12:02:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 12:03:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 12:03:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 12:03:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:03:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:03:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:03:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:03:43 [WARNING ] (13, 1, 'bot')
2018-11-26 12:03:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:03:43 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-11-26 12:03:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 12:04:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 12:04:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 12:04:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:04:44 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-11-26 12:04:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:04:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:04:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:04:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:04:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:04:44 [DEBUG   ] Finished updating board flags in 2.271 seconds
2018-11-26 12:05:04 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-11-26 12:05:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-26 12:05:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:05:44 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-11-26 12:05:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 12:05:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:05:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:05:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:05:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:05:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:05:44 [DEBUG   ] Finished updating board flags in 2.178 seconds
2018-11-26 12:05:48 [DEBUG   ] Got command RPT from MCS: ref #633012
2018-11-26 12:05:48 [DEBUG   ] summary = ERROR
2018-11-26 12:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633012  13 58448 43548693 A  ERRORERROR'
2018-11-26 12:05:48 [DEBUG   ] Got command RPT from MCS: ref #633013
2018-11-26 12:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633013  77 58448 43548694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:06:05 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2018-11-26 12:06:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:06:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:06:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:06:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:06:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:06:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:06:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:06:44 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-11-26 12:06:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:07:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:07:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:07:40 [DEBUG   ] Got command RPT from MCS: ref #633033
2018-11-26 12:07:40 [DEBUG   ] summary = ERROR
2018-11-26 12:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633033  13 58448 43660421 A  ERRORERROR'
2018-11-26 12:07:40 [DEBUG   ] Got command RPT from MCS: ref #633034
2018-11-26 12:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633034  77 58448 43660625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:07:40 [DEBUG   ] Got command RPT from MCS: ref #633035
2018-11-26 12:07:40 [DEBUG   ] summary = ERROR
2018-11-26 12:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633035  13 58448 43660829 A  ERRORERROR'
2018-11-26 12:07:41 [DEBUG   ] Got command RPT from MCS: ref #633036
2018-11-26 12:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633036  77 58448 43661021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:07:41 [DEBUG   ] Got command RPT from MCS: ref #633037
2018-11-26 12:07:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633037  12 58448 43661225 A  ERRORB•™š'
2018-11-26 12:07:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:07:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 12:07:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:07:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:07:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:07:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:07:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:07:44 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-26 12:07:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:08:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:08:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:08:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:08:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:08:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:08:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:08:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:08:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:08:44 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-11-26 12:08:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:09:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:09:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:09:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:09:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:09:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:09:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:09:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:09:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:09:44 [DEBUG   ] Finished updating board flags in 1.904 seconds
2018-11-26 12:09:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:10:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:10:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:10:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 12:10:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:10:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:10:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:10:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:10:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:10:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:10:44 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-11-26 12:10:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:10:48 [DEBUG   ] Got command RPT from MCS: ref #633042
2018-11-26 12:10:48 [DEBUG   ] summary = ERROR
2018-11-26 12:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633042  13 58448 43848689 A  ERRORERROR'
2018-11-26 12:10:48 [DEBUG   ] Got command RPT from MCS: ref #633043
2018-11-26 12:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633043  77 58448 43848690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:11:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:11:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:11:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:11:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 12:11:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:11:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:11:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:11:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:11:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:11:44 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-11-26 12:11:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:12:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:12:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:12:40 [DEBUG   ] Got command RPT from MCS: ref #633061
2018-11-26 12:12:40 [DEBUG   ] summary = ERROR
2018-11-26 12:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633061  13 58448 43960505 A  ERRORERROR'
2018-11-26 12:12:40 [DEBUG   ] Got command RPT from MCS: ref #633062
2018-11-26 12:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633062  77 58448 43960697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:12:40 [DEBUG   ] Got command RPT from MCS: ref #633063
2018-11-26 12:12:40 [DEBUG   ] summary = ERROR
2018-11-26 12:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633063  13 58448 43960901 A  ERRORERROR'
2018-11-26 12:12:41 [DEBUG   ] Got command RPT from MCS: ref #633065
2018-11-26 12:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633065  77 58448 43961105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:12:41 [DEBUG   ] Got command RPT from MCS: ref #633067
2018-11-26 12:12:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633067  12 58448 43961309 A  ERRORB–™š'
2018-11-26 12:12:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:12:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 12:12:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:12:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:12:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:12:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:12:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:12:44 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-26 12:12:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:13:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:13:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:13:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:13:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:13:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:13:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:13:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:13:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:13:44 [DEBUG   ] Finished updating board flags in 1.755 seconds
2018-11-26 12:13:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:14:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:14:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:14:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:14:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:14:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:14:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:14:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:14:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:14:44 [DEBUG   ] Finished updating board flags in 1.636 seconds
2018-11-26 12:14:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-26 12:15:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 12:15:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 12:15:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:15:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:15:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:15:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:15:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:15:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:15:44 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-26 12:15:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:15:48 [DEBUG   ] Got command RPT from MCS: ref #633075
2018-11-26 12:15:48 [DEBUG   ] summary = ERROR
2018-11-26 12:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633075  13 58448 44148689 A  ERRORERROR'
2018-11-26 12:15:48 [DEBUG   ] Got command RPT from MCS: ref #633076
2018-11-26 12:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633076  77 58448 44148690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:16:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 12:16:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 12:16:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:16:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:16:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:16:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:16:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:16:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:16:44 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-11-26 12:16:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 12:17:05 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-26 12:17:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 12:17:40 [DEBUG   ] Got command RPT from MCS: ref #633096
2018-11-26 12:17:40 [DEBUG   ] summary = ERROR
2018-11-26 12:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633096  13 58448 44260577 A  ERRORERROR'
2018-11-26 12:17:40 [DEBUG   ] Got command RPT from MCS: ref #633097
2018-11-26 12:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633097  77 58448 44260781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:17:40 [DEBUG   ] Got command RPT from MCS: ref #633098
2018-11-26 12:17:40 [DEBUG   ] summary = ERROR
2018-11-26 12:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633098  13 58448 44260985 A  ERRORERROR'
2018-11-26 12:17:41 [DEBUG   ] Got command RPT from MCS: ref #633099
2018-11-26 12:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633099  77 58448 44261177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:17:41 [DEBUG   ] Got command RPT from MCS: ref #633100
2018-11-26 12:17:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633100  12 58448 44261381 A  ERRORB—™š'
2018-11-26 12:17:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:17:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:17:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:17:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:17:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:17:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:17:44 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-11-26 12:17:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 12:18:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-26 12:18:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 12:18:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:18:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:18:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:18:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:18:44 [WARNING ] (13, 1, 'bot')
2018-11-26 12:18:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:18:44 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-11-26 12:18:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 12:19:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 12:19:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 12:19:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:19:45 [DEBUG   ] Finished updating ant stats in 0.651 seconds
2018-11-26 12:19:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:19:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:19:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:19:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:19:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:19:45 [DEBUG   ] Finished updating board flags in 2.198 seconds
2018-11-26 12:20:05 [DEBUG   ] Finished updating ant stats in 0.550 seconds
2018-11-26 12:20:26 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-26 12:20:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:20:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 12:20:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:20:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:20:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:20:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:20:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:20:45 [DEBUG   ] Finished updating board flags in 1.940 seconds
2018-11-26 12:20:46 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-11-26 12:20:48 [DEBUG   ] Got command RPT from MCS: ref #633105
2018-11-26 12:20:48 [DEBUG   ] summary = ERROR
2018-11-26 12:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633105  13 58448 44448689 A  ERRORERROR'
2018-11-26 12:20:48 [DEBUG   ] Got command RPT from MCS: ref #633106
2018-11-26 12:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633106  77 58448 44448690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:21:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:21:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 12:21:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:21:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:21:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:21:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:21:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:21:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:21:45 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-11-26 12:21:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:22:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:22:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:22:40 [DEBUG   ] Got command RPT from MCS: ref #633128
2018-11-26 12:22:40 [DEBUG   ] summary = ERROR
2018-11-26 12:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633128  13 58448 44560661 A  ERRORERROR'
2018-11-26 12:22:40 [DEBUG   ] Got command RPT from MCS: ref #633129
2018-11-26 12:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633129  77 58448 44560865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:22:41 [DEBUG   ] Got command RPT from MCS: ref #633130
2018-11-26 12:22:41 [DEBUG   ] summary = ERROR
2018-11-26 12:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633130  13 58448 44561057 A  ERRORERROR'
2018-11-26 12:22:41 [DEBUG   ] Got command RPT from MCS: ref #633132
2018-11-26 12:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633132  77 58448 44561261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:22:41 [DEBUG   ] Got command RPT from MCS: ref #633134
2018-11-26 12:22:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633134  12 58448 44561465 A  ERRORB–™š'
2018-11-26 12:22:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:22:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 12:22:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 12:22:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:22:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:22:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:22:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:22:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:22:46 [DEBUG   ] Finished updating board flags in 2.942 seconds
2018-11-26 12:23:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 12:23:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:23:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:23:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 12:23:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:23:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:23:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:23:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:23:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:23:45 [DEBUG   ] Finished updating board flags in 1.646 seconds
2018-11-26 12:23:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:24:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 12:24:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 12:24:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:24:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:24:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:24:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:24:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:24:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:24:45 [DEBUG   ] Finished updating board flags in 1.641 seconds
2018-11-26 12:24:46 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-26 12:25:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 12:25:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 12:25:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:25:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:25:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:25:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:25:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:25:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:25:45 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-11-26 12:25:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 12:25:48 [DEBUG   ] Got command RPT from MCS: ref #633142
2018-11-26 12:25:48 [DEBUG   ] summary = ERROR
2018-11-26 12:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633142  13 58448 44748697 A  ERRORERROR'
2018-11-26 12:25:48 [DEBUG   ] Got command RPT from MCS: ref #633143
2018-11-26 12:25:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:25:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633143  77 58448 44748698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:26:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-26 12:26:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 12:26:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:26:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:26:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:26:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:26:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:26:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:26:45 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-11-26 12:26:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 12:27:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 12:27:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 12:27:40 [DEBUG   ] Got command RPT from MCS: ref #633159
2018-11-26 12:27:40 [DEBUG   ] summary = ERROR
2018-11-26 12:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633159  13 58448 44860737 A  ERRORERROR'
2018-11-26 12:27:40 [DEBUG   ] Got command RPT from MCS: ref #633160
2018-11-26 12:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633160  77 58448 44860941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:27:41 [DEBUG   ] Got command RPT from MCS: ref #633161
2018-11-26 12:27:41 [DEBUG   ] summary = ERROR
2018-11-26 12:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633161  13 58448 44861145 A  ERRORERROR'
2018-11-26 12:27:41 [DEBUG   ] Got command RPT from MCS: ref #633162
2018-11-26 12:27:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633162  77 58448 44861337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:27:41 [DEBUG   ] Got command RPT from MCS: ref #633163
2018-11-26 12:27:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633163  12 58448 44861541 A  ERRORB–™š'
2018-11-26 12:27:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:27:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 12:27:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:27:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:27:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:27:45 [WARNING ] (13, 1, 'bot')
2018-11-26 12:27:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:27:45 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-11-26 12:27:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 12:28:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 12:28:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 12:28:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 12:28:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:28:46 [DEBUG   ] Finished updating ant stats in 0.652 seconds
2018-11-26 12:28:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:28:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:28:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:28:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:28:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:28:46 [DEBUG   ] Finished updating board flags in 2.316 seconds
2018-11-26 12:29:06 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2018-11-26 12:29:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 12:29:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 12:29:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:29:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:29:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:29:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:29:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:29:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:29:46 [DEBUG   ] Finished updating board flags in 2.127 seconds
2018-11-26 12:29:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 12:30:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:30:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:30:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-26 12:30:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:30:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:30:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:30:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:30:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:30:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:30:46 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-26 12:30:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:30:48 [DEBUG   ] Got command RPT from MCS: ref #633168
2018-11-26 12:30:48 [DEBUG   ] summary = ERROR
2018-11-26 12:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633168  13 58448 45048697 A  ERRORERROR'
2018-11-26 12:30:48 [DEBUG   ] Got command RPT from MCS: ref #633169
2018-11-26 12:30:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633169  77 58448 45048698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:31:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:31:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:31:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:31:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:31:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:31:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:31:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:31:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:31:46 [DEBUG   ] Finished updating board flags in 1.846 seconds
2018-11-26 12:31:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:32:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:32:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:32:40 [DEBUG   ] Got command RPT from MCS: ref #633191
2018-11-26 12:32:40 [DEBUG   ] summary = ERROR
2018-11-26 12:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633191  13 58448 45160821 A  ERRORERROR'
2018-11-26 12:32:41 [DEBUG   ] Got command RPT from MCS: ref #633192
2018-11-26 12:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633192  77 58448 45161025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:32:41 [DEBUG   ] Got command RPT from MCS: ref #633193
2018-11-26 12:32:41 [DEBUG   ] summary = ERROR
2018-11-26 12:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633193  13 58448 45161217 A  ERRORERROR'
2018-11-26 12:32:41 [DEBUG   ] Got command RPT from MCS: ref #633195
2018-11-26 12:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633195  77 58448 45161421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:32:41 [DEBUG   ] Got command RPT from MCS: ref #633196
2018-11-26 12:32:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633196  12 58448 45161625 A  ERRORB—™š'
2018-11-26 12:32:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:32:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:32:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:32:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:32:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:32:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:32:46 [DEBUG   ] Finished updating board flags in 1.744 seconds
2018-11-26 12:32:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:33:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:33:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:33:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:33:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:33:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:33:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:33:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:33:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:33:46 [DEBUG   ] Finished updating board flags in 1.674 seconds
2018-11-26 12:33:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:34:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:34:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:34:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:34:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:34:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:34:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:34:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:34:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:34:46 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-11-26 12:34:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:35:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:35:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:35:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:35:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:35:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:35:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:35:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:35:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:35:46 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-11-26 12:35:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:35:48 [DEBUG   ] Got command RPT from MCS: ref #633205
2018-11-26 12:35:48 [DEBUG   ] summary = ERROR
2018-11-26 12:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633205  13 58448 45348701 A  ERRORERROR'
2018-11-26 12:35:48 [DEBUG   ] Got command RPT from MCS: ref #633206
2018-11-26 12:35:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633206  77 58448 45348702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:36:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:36:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:36:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:36:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:36:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:36:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:36:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:36:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:36:46 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-11-26 12:36:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:37:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:37:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:37:40 [DEBUG   ] Got command RPT from MCS: ref #633226
2018-11-26 12:37:40 [DEBUG   ] summary = ERROR
2018-11-26 12:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633226  13 58448 45460905 A  ERRORERROR'
2018-11-26 12:37:41 [DEBUG   ] Got command RPT from MCS: ref #633227
2018-11-26 12:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633227  77 58448 45461097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:37:41 [DEBUG   ] Got command RPT from MCS: ref #633228
2018-11-26 12:37:41 [DEBUG   ] summary = ERROR
2018-11-26 12:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633228  13 58448 45461301 A  ERRORERROR'
2018-11-26 12:37:41 [DEBUG   ] Got command RPT from MCS: ref #633229
2018-11-26 12:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633229  77 58448 45461505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:37:41 [DEBUG   ] Got command RPT from MCS: ref #633230
2018-11-26 12:37:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633230  12 58448 45461709 A  ERRORB–™š'
2018-11-26 12:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:37:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:37:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:37:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:37:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:37:47 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-11-26 12:37:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:38:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:38:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:38:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:38:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:38:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:38:46 [WARNING ] (13, 1, 'bot')
2018-11-26 12:38:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:38:46 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-11-26 12:38:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:39:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:39:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:39:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:39:47 [DEBUG   ] Finished updating ant stats in 1.256 seconds
2018-11-26 12:39:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:39:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:39:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:39:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:39:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:39:47 [DEBUG   ] Finished updating board flags in 2.160 seconds
2018-11-26 12:40:07 [DEBUG   ] Finished updating ant stats in 1.146 seconds
2018-11-26 12:40:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:40:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 12:40:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:40:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:40:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:40:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:40:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:40:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:40:48 [DEBUG   ] Finished updating board flags in 2.931 seconds
2018-11-26 12:40:48 [DEBUG   ] Got command RPT from MCS: ref #633235
2018-11-26 12:40:48 [DEBUG   ] summary = ERROR
2018-11-26 12:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633235  13 58448 45648693 A  ERRORERROR'
2018-11-26 12:40:48 [DEBUG   ] Got command RPT from MCS: ref #633236
2018-11-26 12:40:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633236  77 58448 45648694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:41:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 12:41:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 12:41:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 12:41:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:41:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:41:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:41:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:41:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:41:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:41:48 [DEBUG   ] Finished updating board flags in 2.204 seconds
2018-11-26 12:42:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 12:42:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 12:42:40 [DEBUG   ] Got command RPT from MCS: ref #633254
2018-11-26 12:42:40 [DEBUG   ] summary = ERROR
2018-11-26 12:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633254  13 58448 45760985 A  ERRORERROR'
2018-11-26 12:42:41 [DEBUG   ] Got command RPT from MCS: ref #633255
2018-11-26 12:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633255  77 58448 45761177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:42:41 [DEBUG   ] Got command RPT from MCS: ref #633256
2018-11-26 12:42:41 [DEBUG   ] summary = ERROR
2018-11-26 12:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633256  13 58448 45761381 A  ERRORERROR'
2018-11-26 12:42:41 [DEBUG   ] Got command RPT from MCS: ref #633258
2018-11-26 12:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633258  77 58448 45761585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:42:41 [DEBUG   ] Got command RPT from MCS: ref #633259
2018-11-26 12:42:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633259  12 58448 45761789 A  ERRORB•™š'
2018-11-26 12:42:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:42:47 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-11-26 12:42:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:42:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:42:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:42:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:42:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:42:47 [DEBUG   ] Finished updating board flags in 1.850 seconds
2018-11-26 12:43:07 [DEBUG   ] Finished updating ant stats in 0.753 seconds
2018-11-26 12:43:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 12:43:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:43:47 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-11-26 12:43:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 12:43:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:43:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:43:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:43:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:43:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:43:47 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-11-26 12:44:07 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-11-26 12:44:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-26 12:44:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:44:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 12:44:47 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2018-11-26 12:44:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:44:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:44:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:44:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:44:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:44:47 [DEBUG   ] Finished updating board flags in 1.742 seconds
2018-11-26 12:45:08 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2018-11-26 12:45:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:45:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 12:45:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-26 12:45:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:45:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:45:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:45:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:45:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:45:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:45:47 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-11-26 12:45:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:45:48 [DEBUG   ] Got command RPT from MCS: ref #633268
2018-11-26 12:45:48 [DEBUG   ] summary = ERROR
2018-11-26 12:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633268  13 58448 45948697 A  ERRORERROR'
2018-11-26 12:45:48 [DEBUG   ] Got command RPT from MCS: ref #633269
2018-11-26 12:45:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:45:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633269  77 58448 45948698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:46:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:46:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:46:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:46:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 12:46:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:46:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:46:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:46:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:46:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:46:47 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-11-26 12:46:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:47:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:47:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:47:41 [DEBUG   ] Got command RPT from MCS: ref #633289
2018-11-26 12:47:41 [DEBUG   ] summary = ERROR
2018-11-26 12:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633289  13 58448 46061065 A  ERRORERROR'
2018-11-26 12:47:41 [DEBUG   ] Got command RPT from MCS: ref #633290
2018-11-26 12:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633290  77 58448 46061257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:47:41 [DEBUG   ] Got command RPT from MCS: ref #633291
2018-11-26 12:47:41 [DEBUG   ] summary = ERROR
2018-11-26 12:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633291  13 58448 46061461 A  ERRORERROR'
2018-11-26 12:47:41 [DEBUG   ] Got command RPT from MCS: ref #633292
2018-11-26 12:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633292  77 58448 46061665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:47:41 [DEBUG   ] Got command RPT from MCS: ref #633293
2018-11-26 12:47:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633293  12 58448 46061857 A  ERRORB—™š'
2018-11-26 12:47:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 12:47:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:47:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:47:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:47:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:47:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:47:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:47:47 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-26 12:47:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:48:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:48:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:48:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:48:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:48:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:48:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:48:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:48:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:48:47 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-11-26 12:48:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:49:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:49:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:49:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:49:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:49:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:49:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:49:47 [WARNING ] (13, 1, 'bot')
2018-11-26 12:49:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:49:47 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-11-26 12:49:48 [DEBUG   ] Finished updating ant stats in 1.182 seconds
2018-11-26 12:50:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 12:50:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 12:50:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:50:48 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-11-26 12:50:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 12:50:48 [DEBUG   ] Got command RPT from MCS: ref #633298
2018-11-26 12:50:48 [DEBUG   ] summary = ERROR
2018-11-26 12:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633298  13 58448 46248701 A  ERRORERROR'
2018-11-26 12:50:48 [DEBUG   ] Got command RPT from MCS: ref #633299
2018-11-26 12:50:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633299  77 58448 46248702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:50:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:50:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:50:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:50:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:50:48 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-11-26 12:51:08 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2018-11-26 12:51:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 12:51:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:51:48 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-11-26 12:51:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:51:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:51:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:51:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:51:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:51:48 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-11-26 12:52:08 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-11-26 12:52:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 12:52:41 [DEBUG   ] Got command RPT from MCS: ref #633321
2018-11-26 12:52:41 [DEBUG   ] summary = ERROR
2018-11-26 12:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633321  13 58448 46361145 A  ERRORERROR'
2018-11-26 12:52:41 [DEBUG   ] Got command RPT from MCS: ref #633322
2018-11-26 12:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633322  77 58448 46361337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:52:41 [DEBUG   ] Got command RPT from MCS: ref #633323
2018-11-26 12:52:41 [DEBUG   ] summary = ERROR
2018-11-26 12:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633323  13 58448 46361541 A  ERRORERROR'
2018-11-26 12:52:41 [DEBUG   ] Got command RPT from MCS: ref #633325
2018-11-26 12:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633325  77 58448 46361745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:52:41 [DEBUG   ] Got command RPT from MCS: ref #633326
2018-11-26 12:52:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633326  12 58448 46361937 A  ERRORB—™š'
2018-11-26 12:52:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:52:48 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-11-26 12:52:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:52:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:52:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:52:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:52:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:52:48 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-11-26 12:53:08 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-11-26 12:53:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-26 12:53:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 12:53:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:53:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:53:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:53:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:53:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:53:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:53:48 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-11-26 12:53:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-26 12:54:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 12:54:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:54:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:54:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:54:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:54:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:54:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:54:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:54:48 [DEBUG   ] Finished updating board flags in 1.835 seconds
2018-11-26 12:54:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 12:55:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 12:55:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 12:55:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:55:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:55:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:55:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:55:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:55:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:55:48 [DEBUG   ] Finished updating board flags in 1.723 seconds
2018-11-26 12:55:48 [DEBUG   ] Got command RPT from MCS: ref #633335
2018-11-26 12:55:48 [DEBUG   ] summary = ERROR
2018-11-26 12:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633335  13 58448 46548705 A  ERRORERROR'
2018-11-26 12:55:48 [DEBUG   ] Got command RPT from MCS: ref #633336
2018-11-26 12:55:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633336  77 58448 46548706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:55:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:56:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 12:56:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 12:56:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:56:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:56:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:56:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:56:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:56:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:56:48 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-26 12:56:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-26 12:57:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:57:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:57:41 [DEBUG   ] Got command RPT from MCS: ref #633352
2018-11-26 12:57:41 [DEBUG   ] summary = ERROR
2018-11-26 12:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633352  13 58448 46661213 A  ERRORERROR'
2018-11-26 12:57:41 [DEBUG   ] Got command RPT from MCS: ref #633353
2018-11-26 12:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633353  77 58448 46661417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:57:41 [DEBUG   ] Got command RPT from MCS: ref #633354
2018-11-26 12:57:41 [DEBUG   ] summary = ERROR
2018-11-26 12:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633354  13 58448 46661621 A  ERRORERROR'
2018-11-26 12:57:41 [DEBUG   ] Got command RPT from MCS: ref #633355
2018-11-26 12:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 12:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633355  77 58448 46661825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 12:57:42 [DEBUG   ] Got command RPT from MCS: ref #633356
2018-11-26 12:57:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 12:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633356  12 58448 46662017 A  ERRORB–™š'
2018-11-26 12:57:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:57:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:57:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:57:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:57:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:57:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:57:48 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-26 12:57:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 12:58:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:58:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:58:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:58:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:58:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:58:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:58:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:58:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:58:48 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-26 12:58:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 12:59:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 12:59:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 12:59:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 12:59:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:59:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:59:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:59:48 [WARNING ] (13, 1, 'bot')
2018-11-26 12:59:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 12:59:48 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-11-26 12:59:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 13:00:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 13:00:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 13:00:48 [DEBUG   ] Got command RPT from MCS: ref #633361
2018-11-26 13:00:48 [DEBUG   ] summary = ERROR
2018-11-26 13:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633361  13 58448 46848697 A  ERRORERROR'
2018-11-26 13:00:48 [DEBUG   ] Got command RPT from MCS: ref #633362
2018-11-26 13:00:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:00:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633362  77 58448 46848698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:00:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:00:49 [DEBUG   ] Finished updating ant stats in 1.052 seconds
2018-11-26 13:00:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:00:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:00:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:00:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:00:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:00:49 [DEBUG   ] Finished updating board flags in 2.304 seconds
2018-11-26 13:01:09 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2018-11-26 13:01:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 13:01:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:01:49 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-11-26 13:01:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:01:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:01:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:01:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:01:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:01:49 [DEBUG   ] Finished updating board flags in 2.110 seconds
2018-11-26 13:02:09 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-11-26 13:02:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 13:02:41 [DEBUG   ] Got command RPT from MCS: ref #633384
2018-11-26 13:02:41 [DEBUG   ] summary = ERROR
2018-11-26 13:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633384  13 58448 46961297 A  ERRORERROR'
2018-11-26 13:02:41 [DEBUG   ] Got command RPT from MCS: ref #633385
2018-11-26 13:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633385  77 58448 46961501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:02:41 [DEBUG   ] Got command RPT from MCS: ref #633386
2018-11-26 13:02:41 [DEBUG   ] summary = ERROR
2018-11-26 13:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633386  13 58448 46961705 A  ERRORERROR'
2018-11-26 13:02:41 [DEBUG   ] Got command RPT from MCS: ref #633388
2018-11-26 13:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633388  77 58448 46961897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:02:42 [DEBUG   ] Got command RPT from MCS: ref #633389
2018-11-26 13:02:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 13:02:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633389  12 58448 46962101 A  ERRORB•™š'
2018-11-26 13:02:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:02:49 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-11-26 13:02:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 13:02:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:02:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:02:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:02:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:02:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:02:49 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-11-26 13:03:09 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-11-26 13:03:29 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-26 13:03:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:03:49 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2018-11-26 13:03:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:03:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:03:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:03:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:03:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:03:49 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-11-26 13:04:10 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2018-11-26 13:04:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:04:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:04:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:04:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:04:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:04:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:04:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:04:49 [DEBUG   ] Finished updating board flags in 1.842 seconds
2018-11-26 13:04:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:05:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 13:05:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 13:05:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:05:48 [DEBUG   ] Got command RPT from MCS: ref #633398
2018-11-26 13:05:48 [DEBUG   ] summary = ERROR
2018-11-26 13:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633398  13 58448 47148697 A  ERRORERROR'
2018-11-26 13:05:48 [DEBUG   ] Got command RPT from MCS: ref #633399
2018-11-26 13:05:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:05:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633399  77 58448 47148698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:05:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:05:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:05:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:05:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:05:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:05:49 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-26 13:05:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-26 13:06:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:06:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 13:06:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-26 13:06:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:06:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:06:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:06:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:06:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:06:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:06:49 [DEBUG   ] Finished updating board flags in 1.747 seconds
2018-11-26 13:06:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:07:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:07:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:07:41 [DEBUG   ] Got command RPT from MCS: ref #633419
2018-11-26 13:07:41 [DEBUG   ] summary = ERROR
2018-11-26 13:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633419  13 58448 47261381 A  ERRORERROR'
2018-11-26 13:07:41 [DEBUG   ] Got command RPT from MCS: ref #633420
2018-11-26 13:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633420  77 58448 47261585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:07:41 [DEBUG   ] Got command RPT from MCS: ref #633421
2018-11-26 13:07:41 [DEBUG   ] summary = ERROR
2018-11-26 13:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633421  13 58448 47261789 A  ERRORERROR'
2018-11-26 13:07:41 [DEBUG   ] Got command RPT from MCS: ref #633422
2018-11-26 13:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633422  77 58448 47261981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:07:42 [DEBUG   ] Got command RPT from MCS: ref #633423
2018-11-26 13:07:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 13:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633423  12 58448 47262185 A  ERRORB—™š'
2018-11-26 13:07:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:07:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:07:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:07:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:07:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:07:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:07:49 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-11-26 13:07:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-26 13:08:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:08:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:08:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:08:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:08:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:08:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:08:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:08:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:08:49 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-11-26 13:08:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:09:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 13:09:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-26 13:09:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:09:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 13:09:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:09:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:09:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:09:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:09:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:09:49 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-11-26 13:09:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 13:10:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 13:10:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-26 13:10:48 [DEBUG   ] Got command RPT from MCS: ref #633428
2018-11-26 13:10:48 [DEBUG   ] summary = ERROR
2018-11-26 13:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633428  13 58448 47448705 A  ERRORERROR'
2018-11-26 13:10:48 [DEBUG   ] Got command RPT from MCS: ref #633429
2018-11-26 13:10:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:10:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633429  77 58448 47448706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:10:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:10:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 13:10:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:10:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:10:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:10:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:10:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:10:49 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-11-26 13:10:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-26 13:11:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-26 13:11:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 13:11:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:11:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:11:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:11:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:11:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:11:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:11:49 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-11-26 13:11:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-26 13:12:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 13:12:31 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-11-26 13:12:41 [DEBUG   ] Got command RPT from MCS: ref #633447
2018-11-26 13:12:41 [DEBUG   ] summary = ERROR
2018-11-26 13:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633447  13 58448 47561461 A  ERRORERROR'
2018-11-26 13:12:41 [DEBUG   ] Got command RPT from MCS: ref #633448
2018-11-26 13:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633448  77 58448 47561665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:12:41 [DEBUG   ] Got command RPT from MCS: ref #633449
2018-11-26 13:12:41 [DEBUG   ] summary = ERROR
2018-11-26 13:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633449  13 58448 47561857 A  ERRORERROR'
2018-11-26 13:12:42 [DEBUG   ] Got command RPT from MCS: ref #633451
2018-11-26 13:12:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633451  77 58448 47562061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:12:42 [DEBUG   ] Got command RPT from MCS: ref #633452
2018-11-26 13:12:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 13:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633452  12 58448 47562265 A  ERRORB—™š'
2018-11-26 13:12:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:12:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:12:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:12:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:12:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:12:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:12:49 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-26 13:12:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 13:13:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-26 13:13:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 13:13:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:13:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 13:13:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:13:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:13:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:13:49 [WARNING ] (13, 1, 'bot')
2018-11-26 13:13:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:13:49 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-11-26 13:13:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 13:14:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 13:14:31 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-11-26 13:14:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:14:50 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-11-26 13:14:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:14:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:14:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:14:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:14:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:14:50 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-11-26 13:15:11 [DEBUG   ] Finished updating ant stats in 1.557 seconds
2018-11-26 13:15:30 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-26 13:15:48 [DEBUG   ] Got command RPT from MCS: ref #633461
2018-11-26 13:15:48 [DEBUG   ] summary = ERROR
2018-11-26 13:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633461  13 58448 47748709 A  ERRORERROR'
2018-11-26 13:15:48 [DEBUG   ] Got command RPT from MCS: ref #633462
2018-11-26 13:15:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:15:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633462  77 58448 47748710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:15:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-26 13:15:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:15:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:15:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:15:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:15:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:15:50 [DEBUG   ] Finished updating board flags in 2.164 seconds
2018-11-26 13:15:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-26 13:16:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-26 13:16:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:16:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:16:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:16:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:16:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:16:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:16:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:16:50 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-11-26 13:16:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-26 13:17:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-26 13:17:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-26 13:17:41 [DEBUG   ] Got command RPT from MCS: ref #633482
2018-11-26 13:17:41 [DEBUG   ] summary = ERROR
2018-11-26 13:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633482  13 58448 47861545 A  ERRORERROR'
2018-11-26 13:17:41 [DEBUG   ] Got command RPT from MCS: ref #633483
2018-11-26 13:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633483  77 58448 47861749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:17:41 [DEBUG   ] Got command RPT from MCS: ref #633484
2018-11-26 13:17:41 [DEBUG   ] summary = ERROR
2018-11-26 13:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633484  13 58448 47861941 A  ERRORERROR'
2018-11-26 13:17:42 [DEBUG   ] Got command RPT from MCS: ref #633485
2018-11-26 13:17:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633485  77 58448 47862145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:17:42 [DEBUG   ] Got command RPT from MCS: ref #633486
2018-11-26 13:17:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 13:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633486  12 58448 47862349 A  ERRORB—™š'
2018-11-26 13:17:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:17:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:17:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:17:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:17:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:17:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:17:50 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-11-26 13:17:51 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-26 13:18:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 13:18:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 13:18:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:18:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:18:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:18:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:18:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:18:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:18:50 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-26 13:18:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 13:19:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 13:19:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 13:19:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:19:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:19:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:19:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:19:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:19:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:19:50 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-11-26 13:19:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 13:20:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 13:20:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 13:20:48 [DEBUG   ] Got command RPT from MCS: ref #633491
2018-11-26 13:20:48 [DEBUG   ] summary = ERROR
2018-11-26 13:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633491  13 58448 48048709 A  ERRORERROR'
2018-11-26 13:20:48 [DEBUG   ] Got command RPT from MCS: ref #633492
2018-11-26 13:20:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633492  77 58448 48048710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:20:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:20:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:20:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:20:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:20:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:20:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:20:50 [DEBUG   ] Finished updating board flags in 1.715 seconds
2018-11-26 13:20:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 13:21:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 13:21:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 13:21:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:21:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:21:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:21:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:21:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:21:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:21:50 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-26 13:21:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-26 13:22:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-26 13:22:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-26 13:22:41 [DEBUG   ] Got command RPT from MCS: ref #633514
2018-11-26 13:22:41 [DEBUG   ] summary = ERROR
2018-11-26 13:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633514  13 58448 48161621 A  ERRORERROR'
2018-11-26 13:22:41 [DEBUG   ] Got command RPT from MCS: ref #633515
2018-11-26 13:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633515  77 58448 48161825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:22:42 [DEBUG   ] Got command RPT from MCS: ref #633516
2018-11-26 13:22:42 [DEBUG   ] summary = ERROR
2018-11-26 13:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633516  13 58448 48162029 A  ERRORERROR'
2018-11-26 13:22:42 [DEBUG   ] Got command RPT from MCS: ref #633518
2018-11-26 13:22:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-26 13:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633518  77 58448 48162221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-26 13:22:42 [DEBUG   ] Got command RPT from MCS: ref #633519
2018-11-26 13:22:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-26 13:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   633519  12 58448 48162425 A  ERRORB—™š'
2018-11-26 13:22:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:22:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:22:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:22:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:22:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:22:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:22:50 [DEBUG   ] Finished updating board flags in 1.661 seconds
2018-11-26 13:22:51 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-26 13:23:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-26 13:23:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-26 13:23:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:23:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:23:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:23:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:23:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:23:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:23:50 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-11-26 13:23:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-26 13:24:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-26 13:24:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-26 13:24:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-26 13:24:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-26 13:24:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:24:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:24:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:24:50 [WARNING ] (13, 1, 'bot')
2018-11-26 13:24:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-26 13:24:50 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-11-26 13:24:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
